Sep 09 03:43:51 devstack cinder-volume[76604]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 09 03:43:51 devstack cinder-volume[76604]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 09 03:43:51 devstack cinder-volume[76604]: we strongly recommend against using it for new projects.
Sep 09 03:43:51 devstack cinder-volume[76604]: If you are already using Eventlet, we recommend migrating to a different
Sep 09 03:43:51 devstack cinder-volume[76604]: framework.  For more detail see
Sep 09 03:43:51 devstack cinder-volume[76604]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 09 03:43:51 devstack cinder-volume[76604]:   import eventlet  # noqa
Sep 09 03:43:54 devstack cinder-volume[76604]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 03:43:54 devstack cinder-volume[76604]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 03:43:54 devstack cinder-volume[76604]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 03:43:55 devstack cinder-volume[76604]: INFO dbcounter [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Registered counter for database cinder
Sep 09 03:43:55 devstack cinder-volume[76604]: DEBUG oslo_db.sqlalchemy.engines [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76604) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 03:43:56 devstack cinder-volume[76604]: DEBUG dbcounter [-] [76604] Writer thread running {{(pid=76604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 09 03:43:56 devstack cinder-volume[76604]: INFO cinder.rpc [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 09 03:43:56 devstack cinder-volume[76604]: INFO cinder.rpc [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 09 03:43:56 devstack cinder-volume[76604]: DEBUG oslo_db.sqlalchemy.engines [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76604) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 03:43:56 devstack cinder-volume[76604]: INFO cinder.volume.manager [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Determined volume DB was empty at startup.
Sep 09 03:43:56 devstack cinder-volume[76604]: DEBUG cinder.volume.manager [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76604) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 09 03:43:56 devstack cinder-volume[76604]: INFO cinder.volume.manager [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 09 03:43:56 devstack cinder-volume[76604]: WARNING stevedore.named [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 09 03:43:56 devstack cinder-volume[76604]: WARNING castellan.key_manager [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 03:43:56 devstack cinder-volume[76604]: WARNING cinder.keymgr.conf_key_mgr [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 03:43:56 devstack cinder-volume[76604]: DEBUG cinder.volume.drivers.lvm [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76604) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 09 03:43:56 devstack cinder-volume[76604]: DEBUG oslo_concurrency.processutils [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:56 devstack cinder-volume[76604]: DEBUG oslo_concurrency.processutils [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] CMD "cinder-rtstool verify" returned: 0 in 0.467s {{(pid=76604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:56 devstack cinder-volume[76604]: DEBUG oslo_db.sqlalchemy.engines [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76604) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 03:43:56 devstack cinder-volume[76604]: INFO cinder.rpc [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 09 03:43:56 devstack cinder-volume[76604]: INFO cinder.rpc [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 09 03:43:56 devstack cinder-volume[76604]: WARNING stevedore.named [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 09 03:43:56 devstack cinder-volume[76604]: WARNING castellan.key_manager [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 03:43:56 devstack cinder-volume[76604]: INFO cinder.volume.manager [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 09 03:43:56 devstack cinder-volume[76604]: DEBUG oslo_db.sqlalchemy.engines [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76604) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 03:43:56 devstack cinder-volume[76604]: INFO oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Starting 1 workers
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Started child 76757 {{(pid=76604) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Full set of CONF: {{(pid=76604) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] ******************************************************************************** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Configuration options gathered from: {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] ================================================================================ {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] allow_availability_zone_fallback = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] allow_compression_on_image_upload = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] allowed_direct_url_schemes     = [] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76757]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] api_rate_limit                 = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] auth_strategy                  = keystone {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] az_cache_duration              = 3600 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_availability_zone      = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_host                   = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_name                   = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_stats_polling_interval = 60 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backup_api_class               = cinder.backup.api.API {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backup_name_template           = backup-%s {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backup_use_same_host           = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backup_use_temp_snapshot       = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] chap_password                  = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] chap_username                  =  {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cinder_internal_tenant_project_id = ce36118a21274cf9ac4da31fab3d5148 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cinder_internal_tenant_user_id = d74b4192761942c0948bec51cab90b86 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cloned_volume_same_az          = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cluster                        = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] compression_format             = gzip {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] config_dir                     = [] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] config_source                  = [] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] control_exchange               = openstack {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] debug                          = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] default_availability_zone      = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] default_group_type             = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] default_volume_type            = lvmdriver-1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] disk_geometry                  = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] driver_client_cert             = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] driver_client_cert_key         = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] driver_data_namespace          = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] driver_ssl_cert_path           = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] driver_ssl_cert_verify         = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] driver_use_ssl                 = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] enable_force_upload            = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] enable_new_services            = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] enable_unsupported_driver      = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] enforce_multipath_for_image_xfer = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] filter_function                = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance_api_insecure            = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance_api_servers             = ['http://192.168.122.155/image'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance_api_ssl_compression     = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance_ca_certificates_file    = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance_certfile                = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance_keyfile                 = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance_num_retries             = 3 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance_request_timeout         = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] goodness_function              = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] graceful_shutdown_timeout      = 5 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] group_api_class                = cinder.group.api.API {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] host                           = devstack {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] image_compress_on_upload       = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] image_conversion_address_space_limit = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] image_conversion_cpu_limit     = 60 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] image_conversion_disable       = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] image_upload_use_cinder_backend = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] image_upload_use_internal_tenant = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] image_volume_cache_enabled     = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] image_volume_cache_max_count   = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] image_volume_cache_max_size_gb = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] init_host_max_objects_retrieval = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] iscsi_target_flags             =  {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] iscsi_write_cache              = on {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] iser_helper                    = tgtadm {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] iser_ip_address                = 192.168.122.155 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] iser_port                      = 3260 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] log_color                      = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] log_config_append              = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] log_dir                        = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] log_file                       = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] log_options                    = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76757]: INFO cinder.volume.manager [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] log_rotate_interval            = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] log_rotate_interval_type       = days {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] log_rotation_type              = none {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] max_age                        = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] max_logfile_count              = 30 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] max_logfile_size_mb            = 200 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] max_over_subscription_ratio    = 20.0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] message_reap_interval          = 86400 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] message_ttl                    = 2592000 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] migration_create_volume_timeout_secs = 300 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] monkey_patch                   = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] monkey_patch_modules           = [] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] my_ip                          = 192.168.122.155 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] no_snapshot_gb_quota           = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] num_iser_scan_tries            = 3 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] num_shell_tries                = 3 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] num_volume_device_scan_tries   = 3 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] nvmeof_conn_info_version       = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] nvmet_ns_id                    = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] nvmet_port_id                  = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] osapi_max_limit                = 1000 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] osapi_volume_ext_list          = [] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] osapi_volume_listen_port       = 8776 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] osapi_volume_use_ssl           = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] osapi_volume_workers           = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] per_volume_size_limit          = -1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] periodic_fuzzy_delay           = 60 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] periodic_interval              = 60 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] public_endpoint                = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] publish_errors                 = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] quota_backup_gigabytes         = 1000 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] quota_backups                  = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] quota_gigabytes                = 1000 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] quota_groups                   = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] quota_snapshots                = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] quota_volumes                  = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] rate_limit_burst               = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] rate_limit_except_level        = CRITICAL {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] rate_limit_interval            = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] reinit_driver_count            = 3 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] replication_device             = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] report_discard_supported       = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] report_interval                = 120 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] reservation_clean_interval     = 86400 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] reservation_expire             = 86400 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] reserved_image_namespaces      = [] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] reserved_percentage            = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] rpc_response_timeout           = 120 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] run_external_periodic_tasks    = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] scst_target_driver             = iscsi {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] scst_target_iqn_name           = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] service_down_time              = 720 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] shell_completion               = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] snapshot_name_template         = snapshot-%s {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] snapshot_same_host             = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] split_loggers                  = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] state_path                     = /opt/stack/data/cinder {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] storage_availability_zone      = nova {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] storage_protocol               = iSCSI {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] syslog_log_facility            = LOG_USER {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] target_helper                  = lioadm {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] target_ip_address              = 192.168.122.155 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] target_port                    = 3260 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] target_protocol                = iscsi {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] target_secondary_ip_addresses  = [] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] trace_flags                    = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] transport_url                  = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] until_refresh                  = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] use_chap_auth                  = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] use_default_quota_class        = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] use_journal                    = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] use_json                       = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] use_multipath_for_image_xfer   = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] use_stderr                     = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] use_syslog                     = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] verify_glance_signatures       = enabled {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] volume_api_class               = cinder.volume.api.API {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] volume_backend_name            = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] volume_clear                   = zero {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] volume_clear_ionice            = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] volume_clear_size              = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] volume_copy_bps_limit          = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] volume_dd_blocksize            = 1M {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] volume_name_template           = volume-%s {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] volume_service_inithost_offload = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] volume_usage_audit_period      = month {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] zoning_mode                    = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_concurrency.disable_process_locking = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.auth_section = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.auth_type   = password {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.auth_version = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.cache       = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.certfile    = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.include_service_catalog = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.insecure    = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.interface   = public {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.keyfile     = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_password = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcache_username = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.region_name = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.service_type = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.155/identity {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.backend                  = dogpile.cache.null {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.backend_argument         = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.backend_expiration_time  = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.config_prefix            = cache.oslo {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.debug_cache_backend      = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.enable_retry_client      = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.enable_socket_keepalive  = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.enabled                  = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.expiration_time          = 600 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.hashclient_retry_attempts = 2 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.memcache_dead_retry      = 300 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.memcache_sasl_enabled    = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.password                 = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.proxies                  = [] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.redis_db                 = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.redis_server             = localhost:6379 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.retry_attempts           = 2 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.retry_delay              = 0.0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.socket_keepalive_count   = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.socket_keepalive_idle    = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.socket_keepalive_interval = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.socket_timeout           = 1.0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.tls_allowed_ciphers      = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.tls_cafile               = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.tls_certfile             = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.tls_enabled              = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.tls_keyfile              = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cache.username                 = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] coordination.backend_url       = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.asyncio_connection    = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.asyncio_slave_connection = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.backend               = sqlalchemy {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.connection            = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.connection_debug      = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.connection_parameters =  {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.connection_recycle_time = 3600 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack sudo[76769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.connection_trace      = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.db_inc_retry_interval = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.db_max_retries        = 20 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.db_max_retry_interval = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.db_retry_interval     = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.max_overflow          = 50 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.max_pool_size         = 5 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack sudo[76769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.max_retries           = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.mysql_wsrep_sync_wait = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.pool_timeout          = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.retry_interval        = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.slave_connection      = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.sqlite_synchronous    = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.synchronous_reader    = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] database.use_db_reconnect      = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_tracing.insecure = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler.connection_string     = messaging:// {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler.enabled               = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler.es_doc_type           = notification {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler.es_scroll_size        = 10000 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler.es_scroll_time        = 2m {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler.filter_error_trace    = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler.hmac_keys             = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler.sentinel_service_name = mymaster {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler.socket_timeout        = 0.1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler.trace_requests        = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler.trace_sqlalchemy      = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler_jaeger.process_tags   = {} {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler_jaeger.service_name_prefix = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] profiler_otlp.service_name_prefix = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_policy.enforce_new_defaults = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_policy.policy_default_rule = default {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] privsep_osbrick.group          = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] privsep_osbrick.helper_command = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] privsep_osbrick.user           = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cinder_sys_admin.group         = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cinder_sys_admin.helper_command = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] cinder_sys_admin.user          = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] service_user.auth_section      = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] service_user.auth_type         = password {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] service_user.cafile            = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] service_user.certfile          = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] service_user.collect_timing    = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] service_user.insecure          = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] service_user.keyfile           = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] service_user.send_service_user_token = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] service_user.split_loggers     = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] service_user.timeout           = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] service_user.tls_ciphers       = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] service_user.tls_min_version   = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance.auth_section            = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance.auth_type               = password {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance.certfile                = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance.collect_timing          = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance.insecure                = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance.keyfile                 = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance.region_name             = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance.split_loggers           = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance.timeout                 = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance.tls_ciphers             = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] glance.tls_min_version         = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.backend_availability_zone = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.chap_password = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.chap_username =  {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.disk_geometry = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.driver_client_cert = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.driver_client_cert_key = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.driver_data_namespace = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.driver_use_ssl = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.extra_capabilities = {} {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.filter_function = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.goodness_function = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.iscsi_target_flags =  {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.iscsi_write_cache = on {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.iser_ip_address = 192.168.122.155 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.iser_port     = 3260 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.lvm_share_target = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.lvm_type      = auto {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.num_shell_tries = 3 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.replication_device = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.report_discard_supported = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.reserved_percentage = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.target_helper = tgtadm {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.target_ip_address = 192.168.122.155 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.target_port   = 3260 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.target_protocol = iscsi {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.trace_flags   = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.unique_fqdn_network = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.use_chap_auth = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.volume_backend_name = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.volume_clear  = zero {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.volume_clear_ionice = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.volume_clear_size = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_reports.file_event_handler = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_reports.log_dir           = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.backend_host       = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.chap_password      = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.chap_username      = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.disk_geometry      = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.driver_client_cert = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.extra_capabilities = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.filter_function    = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.goodness_function  = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.iser_helper        = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.iser_port          = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.lvm_type           = auto {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.replication_device = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.report_discard_supported = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.reserved_percentage = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.scst_target_driver = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.storage_protocol   = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.target_ip_address  = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.target_port        = 3260 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.trace_flags        = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.volume_clear       = zero {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] lvmdriver-1.volumes_dir        = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_notifications.driver = [] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_notifications.retry = -1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] key_manager.fixed_key          = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.barbican_api_version  = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.barbican_endpoint     = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.barbican_endpoint_type = public {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.barbican_region_name  = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.cafile                = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.certfile              = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.collect_timing        = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.insecure              = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.keyfile               = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.number_of_retries     = 60 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.retry_delay           = 1 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.send_service_user_token = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.split_loggers         = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.timeout               = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.tls_ciphers           = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.tls_min_version       = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.verify_ssl            = True {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican.verify_ssl_path       = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican_service_user.auth_section = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican_service_user.auth_type = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican_service_user.cafile   = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican_service_user.certfile = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican_service_user.collect_timing = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican_service_user.insecure = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican_service_user.keyfile  = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican_service_user.split_loggers = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican_service_user.timeout  = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican_service_user.tls_ciphers = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] barbican_service_user.tls_min_version = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.approle_role_id          = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.approle_secret_id        = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.auth_method              = approle {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.auth_path                = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.kv_mountpoint            = secret {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.kv_path                  = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.kv_version               = 2 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.namespace                = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.root_token_id            = **** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.ssl_ca_crt_file          = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.timeout                  = 60.0 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.token_file               = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.token_role               = None {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.use_ssl                  = False {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:43:57 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] ******************************************************************************** {{(pid=76604) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 09 03:43:57 devstack sudo[76769]: pam_unix(sudo:session): session closed for user root
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:57 devstack sudo[76880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 03:43:57 devstack sudo[76880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:43:57 devstack sudo[76880]: pam_unix(sudo:session): session closed for user root
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.253s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 03:43:57 devstack cinder-volume[76757]: INFO cinder.brick.local_dev.lvm [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:57 devstack sudo[76991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 03:43:57 devstack sudo[76991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:43:57 devstack sudo[76991]: pam_unix(sudo:session): session closed for user root
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG cinder.brick.local_dev.lvm [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76757) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 09 03:43:57 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:58 devstack sudo[77087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 03:43:58 devstack sudo[77087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:43:58 devstack sudo[77087]: pam_unix(sudo:session): session closed for user root
Sep 09 03:43:58 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.480s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:58 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:58 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:58 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:58 devstack sudo[77267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 03:43:58 devstack sudo[77267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:43:58 devstack sudo[77267]: pam_unix(sudo:session): session closed for user root
Sep 09 03:43:58 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:58 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:58 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:58 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:58 devstack sudo[77368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 09 03:43:58 devstack sudo[77368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:43:59 devstack sudo[77368]: pam_unix(sudo:session): session closed for user root
Sep 09 03:43:59 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.278s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:59 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:59 devstack sudo[77371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 03:43:59 devstack sudo[77371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:43:59 devstack sudo[77371]: pam_unix(sudo:session): session closed for user root
Sep 09 03:43:59 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.346s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:59 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:59 devstack sudo[77455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 03:43:59 devstack sudo[77455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:43:59 devstack sudo[77455]: pam_unix(sudo:session): session closed for user root
Sep 09 03:43:59 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:59 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:43:59 devstack sudo[77458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:43:59 devstack sudo[77458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:43:59 devstack sudo[77458]: pam_unix(sudo:session): session closed for user root
Sep 09 03:43:59 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:43:59 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:00 devstack sudo[77527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 03:44:00 devstack sudo[77527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:00 devstack sudo[77527]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:00 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:00 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:00 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:00 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:00 devstack sudo[77551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 03:44:00 devstack sudo[77551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:00 devstack sudo[77551]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:00 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:00 devstack cinder-volume[76757]: INFO cinder.volume.drivers.lvm [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 09 03:44:00 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:00 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:00 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:00 devstack sudo[77561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 03:44:00 devstack sudo[77561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:00 devstack sudo[77561]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:00 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:00 devstack cinder-volume[76757]: DEBUG cinder.volume.drivers.lvm [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Updating volume stats {{(pid=76757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 03:44:00 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:00 devstack sudo[77564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 03:44:00 devstack sudo[77564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:01 devstack sudo[77564]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:01 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:01 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:01 devstack sudo[77567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:44:01 devstack sudo[77567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:01 devstack sudo[77567]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:01 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:01 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:01 devstack sudo[77570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 03:44:01 devstack sudo[77570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:01 devstack sudo[77570]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:01 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:01 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:01 devstack sudo[77573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:44:01 devstack sudo[77573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:01 devstack sudo[77573]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:01 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:01 devstack cinder-volume[76757]: INFO cinder.volume.driver [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Driver hasn't implemented _init_vendor_properties()
Sep 09 03:44:01 devstack cinder-volume[76757]: DEBUG cinder.volume.driver [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76757) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 09 03:44:01 devstack cinder-volume[76757]: DEBUG oslo_db.sqlalchemy.engines [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76757) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 03:44:01 devstack cinder-volume[76757]: DEBUG dbcounter [-] [76757] Writer thread running {{(pid=76757) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 09 03:44:01 devstack cinder-volume[76757]: DEBUG cinder.db.api [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Building query based on filter {{(pid=76757) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 09 03:44:02 devstack cinder-volume[76757]: DEBUG cinder.image.image_utils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76757) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 09 03:44:02 devstack cinder-volume[76757]: INFO cinder.keymgr.migration [None req-99fe58d2-d1fd-4284-b5e7-ff1b7b54d9a0 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 09 03:44:02 devstack cinder-volume[76757]: DEBUG cinder.volume.drivers.lvm [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Updating volume stats {{(pid=76757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 03:44:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:02 devstack sudo[77576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 03:44:02 devstack sudo[77576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:02 devstack sudo[77576]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:02 devstack sudo[77582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:44:02 devstack sudo[77582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:02 devstack sudo[77582]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:02 devstack sudo[77585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 03:44:02 devstack sudo[77585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:02 devstack sudo[77585]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:02 devstack sudo[77588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:44:02 devstack sudo[77588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:03 devstack sudo[77588]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:03 devstack cinder-volume[76757]: DEBUG cinder.manager [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Notifying Schedulers of capabilities ... {{(pid=76757) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:44:03 devstack cinder-volume[76757]: INFO cinder.volume.manager [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Driver initialization completed successfully.
Sep 09 03:44:03 devstack cinder-volume[76757]: INFO cinder.manager [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Initiating service 2 cleanup
Sep 09 03:44:03 devstack cinder-volume[76757]: INFO cinder.manager [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Service 2 cleanup completed.
Sep 09 03:44:03 devstack cinder-volume[76757]: DEBUG cinder.service [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Creating RPC server for service cinder-volume {{(pid=76757) start /opt/stack/cinder/cinder/service.py:231}}
Sep 09 03:44:03 devstack cinder-volume[76757]: DEBUG cinder.service [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76757) start /opt/stack/cinder/cinder/service.py:237}}
Sep 09 03:44:03 devstack cinder-volume[76757]: INFO cinder.volume.manager [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 09 03:44:03 devstack cinder-volume[76757]: DEBUG cinder.volume.drivers.lvm [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Updating volume stats {{(pid=76757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 03:44:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:03 devstack sudo[77591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 03:44:03 devstack sudo[77591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:03 devstack sudo[77591]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:03 devstack sudo[77596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:44:03 devstack sudo[77596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:03 devstack sudo[77596]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:03 devstack sudo[77602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 03:44:03 devstack sudo[77602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:04 devstack sudo[77602]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:04 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:04 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:44:04 devstack sudo[77606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:44:04 devstack sudo[77606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:44:04 devstack sudo[77606]: pam_unix(sudo:session): session closed for user root
Sep 09 03:44:04 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:44:04 devstack cinder-volume[76757]: INFO cinder.volume.manager [None req-794a46f6-5a48-4a42-a7c5-af802471fed9 None None] Driver post RPC initialization completed successfully.
Sep 09 03:44:06 devstack cinder-volume[76604]: DEBUG dbcounter [-] [76604] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:44:13 devstack cinder-volume[76757]: DEBUG dbcounter [-] [76757] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76757) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:44:14 devstack cinder-volume[76757]: DEBUG dbcounter [-] [76757] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76757) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:45:02 devstack cinder-volume[76757]: DEBUG oslo_service.periodic_task [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76757) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:45:02 devstack cinder-volume[76757]: DEBUG cinder.volume.drivers.lvm [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Updating volume stats {{(pid=76757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 03:45:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:45:02 devstack sudo[79615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 03:45:02 devstack sudo[79615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:45:02 devstack sudo[79615]: pam_unix(sudo:session): session closed for user root
Sep 09 03:45:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:45:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:45:02 devstack sudo[79618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:45:02 devstack sudo[79618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:45:02 devstack sudo[79618]: pam_unix(sudo:session): session closed for user root
Sep 09 03:45:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:45:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:45:02 devstack sudo[79621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 03:45:02 devstack sudo[79621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:45:03 devstack sudo[79621]: pam_unix(sudo:session): session closed for user root
Sep 09 03:45:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:45:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:45:03 devstack sudo[79624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:45:03 devstack sudo[79624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:45:03 devstack sudo[79624]: pam_unix(sudo:session): session closed for user root
Sep 09 03:45:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:45:03 devstack cinder-volume[76757]: DEBUG cinder.manager [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Notifying Schedulers of capabilities ... {{(pid=76757) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:45:03 devstack cinder-volume[76757]: DEBUG oslo_service.periodic_task [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running periodic task VolumeManager._thread_info {{(pid=76757) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:45:03 devstack cinder-volume[76757]: DEBUG cinder.volume.manager [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] thread count: 6 {{(pid=76757) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 03:45:03 devstack cinder-volume[76757]: DEBUG cinder.volume.manager [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] thread info: [<_MainThread(MainThread, started 124473396859008)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124473282198592)>, <Thread(Thread-3 (stat_writer), started daemon 124473285914944)>, <Thread(Rabbit-heartbeat, started daemon 124473282053056)>, <Thread(Thread-5 (_runner), started daemon 124473282103488)>, <Thread(Thread-7 (_runner), started daemon 124473280172480)>] {{(pid=76757) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 03:46:02 devstack cinder-volume[76757]: DEBUG oslo_service.periodic_task [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76757) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:46:02 devstack cinder-volume[76757]: DEBUG cinder.volume.drivers.lvm [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Updating volume stats {{(pid=76757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 03:46:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:46:02 devstack sudo[82901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 03:46:02 devstack sudo[82901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:46:02 devstack sudo[82901]: pam_unix(sudo:session): session closed for user root
Sep 09 03:46:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:46:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:46:02 devstack sudo[82905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:46:02 devstack sudo[82905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:46:02 devstack sudo[82905]: pam_unix(sudo:session): session closed for user root
Sep 09 03:46:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:46:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:46:03 devstack sudo[82912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 03:46:03 devstack sudo[82912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:46:03 devstack sudo[82912]: pam_unix(sudo:session): session closed for user root
Sep 09 03:46:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:46:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:46:03 devstack sudo[82923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:46:03 devstack sudo[82923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:46:03 devstack sudo[82923]: pam_unix(sudo:session): session closed for user root
Sep 09 03:46:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:46:03 devstack cinder-volume[76757]: DEBUG cinder.manager [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Notifying Schedulers of capabilities ... {{(pid=76757) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:46:03 devstack cinder-volume[76757]: DEBUG oslo_service.periodic_task [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running periodic task VolumeManager._thread_info {{(pid=76757) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:46:03 devstack cinder-volume[76757]: DEBUG cinder.volume.manager [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] thread count: 6 {{(pid=76757) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 03:46:03 devstack cinder-volume[76757]: DEBUG cinder.volume.manager [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] thread info: [<_MainThread(MainThread, started 124473396859008)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124473282198592)>, <Thread(Thread-3 (stat_writer), started daemon 124473285914944)>, <Thread(Rabbit-heartbeat, started daemon 124473282053056)>, <Thread(Thread-5 (_runner), started daemon 124473282103488)>, <Thread(Thread-7 (_runner), started daemon 124473280172480)>] {{(pid=76757) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 03:46:14 devstack cinder-volume[76757]: DEBUG dbcounter [-] [76757] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76757) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:47:02 devstack cinder-volume[76757]: DEBUG oslo_service.periodic_task [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76757) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:47:02 devstack cinder-volume[76757]: DEBUG cinder.volume.drivers.lvm [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Updating volume stats {{(pid=76757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 03:47:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:47:02 devstack sudo[84873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 03:47:02 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:47:02 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root
Sep 09 03:47:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:47:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:47:02 devstack sudo[84896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:47:02 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:47:02 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root
Sep 09 03:47:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:47:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:47:02 devstack sudo[84899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 03:47:02 devstack sudo[84899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:47:03 devstack sudo[84899]: pam_unix(sudo:session): session closed for user root
Sep 09 03:47:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:47:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:47:03 devstack sudo[84913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:47:03 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:47:03 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root
Sep 09 03:47:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:47:03 devstack cinder-volume[76757]: DEBUG cinder.manager [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Notifying Schedulers of capabilities ... {{(pid=76757) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:48:02 devstack cinder-volume[76757]: DEBUG oslo_service.periodic_task [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76757) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:48:02 devstack cinder-volume[76757]: DEBUG cinder.volume.drivers.lvm [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Updating volume stats {{(pid=76757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 03:48:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:48:02 devstack sudo[86142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 03:48:02 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:48:02 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root
Sep 09 03:48:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:48:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:48:02 devstack sudo[86145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:48:02 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:48:02 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root
Sep 09 03:48:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:48:02 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:48:02 devstack sudo[86148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 03:48:02 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:48:03 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root
Sep 09 03:48:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:48:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:48:03 devstack sudo[86151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 03:48:03 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:48:03 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root
Sep 09 03:48:03 devstack cinder-volume[76757]: DEBUG oslo_concurrency.processutils [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:48:03 devstack cinder-volume[76757]: DEBUG cinder.manager [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Notifying Schedulers of capabilities ... {{(pid=76757) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:48:03 devstack cinder-volume[76757]: DEBUG oslo_service.periodic_task [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] Running periodic task VolumeManager._thread_info {{(pid=76757) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:48:03 devstack cinder-volume[76757]: DEBUG cinder.volume.manager [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] thread count: 6 {{(pid=76757) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 03:48:03 devstack cinder-volume[76757]: DEBUG cinder.volume.manager [None req-a75c057b-8ab8-4a9d-bb06-3fc6971a4135 None None] thread info: [<_MainThread(MainThread, started 124473396859008)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124473282198592)>, <Thread(Thread-3 (stat_writer), started daemon 124473285914944)>, <Thread(Rabbit-heartbeat, started daemon 124473282053056)>, <Thread(Thread-5 (_runner), started daemon 124473282103488)>, <Thread(Thread-7 (_runner), started daemon 124473280172480)>] {{(pid=76757) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 03:48:14 devstack cinder-volume[76757]: DEBUG dbcounter [-] [76757] Writing DB stats cinder:SELECT=1 {{(pid=76757) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:48:14 devstack cinder-volume[76757]: DEBUG dbcounter [-] [76757] Writing DB stats cinder:UPDATE=1 {{(pid=76757) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:48:26 devstack cinder-volume[76604]: INFO oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Caught SIGTERM, stopping children
Sep 09 03:48:26 devstack cinder-volume[76604]: DEBUG oslo_concurrency.lockutils [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Acquiring lock "singleton_lock" {{(pid=76604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 03:48:26 devstack cinder-volume[76604]: DEBUG oslo_concurrency.lockutils [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Acquired lock "singleton_lock" {{(pid=76604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 03:48:26 devstack cinder-volume[76604]: DEBUG oslo_concurrency.lockutils [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Releasing lock "singleton_lock" {{(pid=76604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 03:48:26 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Stop services. {{(pid=76604) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 09 03:48:26 devstack cinder-volume[76604]: DEBUG oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Killing children. {{(pid=76604) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 09 03:48:26 devstack cinder-volume[76604]: INFO oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Waiting on 1 children to exit
Sep 09 03:48:28 devstack cinder-volume[76757]: DEBUG oslo_concurrency.lockutils [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Acquiring lock "singleton_lock" {{(pid=76757) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 03:48:28 devstack cinder-volume[76757]: DEBUG oslo_concurrency.lockutils [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Acquired lock "singleton_lock" {{(pid=76757) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 03:48:28 devstack cinder-volume[76757]: DEBUG oslo_concurrency.lockutils [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Releasing lock "singleton_lock" {{(pid=76757) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 03:48:28 devstack cinder-volume[76757]: WARNING amqp [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 09 03:48:28 devstack cinder-volume[76757]: WARNING amqp [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 09 03:48:28 devstack cinder-volume[76604]: INFO oslo_service.backend._eventlet.service [None req-6c6a02f2-ac37-435e-a642-b6cb6bb06004 None None] Child 76757 exited with status 0
Sep 09 03:48:28 devstack cinder-volume[86757]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 09 03:48:28 devstack cinder-volume[86757]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 09 03:48:28 devstack cinder-volume[86757]: we strongly recommend against using it for new projects.
Sep 09 03:48:28 devstack cinder-volume[86757]: If you are already using Eventlet, we recommend migrating to a different
Sep 09 03:48:28 devstack cinder-volume[86757]: framework.  For more detail see
Sep 09 03:48:28 devstack cinder-volume[86757]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 09 03:48:28 devstack cinder-volume[86757]:   import eventlet  # noqa
Sep 09 03:48:30 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86757) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 03:48:30 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86757) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 03:48:30 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86757) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 03:48:31 devstack cinder-volume[86757]: INFO dbcounter [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Registered counter for database cinder
Sep 09 03:48:31 devstack cinder-volume[86757]: DEBUG oslo_db.sqlalchemy.engines [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86757) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 03:48:31 devstack cinder-volume[86757]: DEBUG dbcounter [-] [86757] Writer thread running {{(pid=86757) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 09 03:48:31 devstack cinder-volume[86757]: INFO cinder.rpc [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 09 03:48:31 devstack cinder-volume[86757]: INFO cinder.rpc [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 09 03:48:31 devstack cinder-volume[86757]: DEBUG oslo_db.sqlalchemy.engines [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86757) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 03:48:31 devstack cinder-volume[86757]: INFO cinder.volume.manager [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Determined volume DB was empty at startup.
Sep 09 03:48:31 devstack cinder-volume[86757]: DEBUG cinder.volume.manager [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86757) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 09 03:48:32 devstack cinder-volume[86757]: INFO cinder.volume.manager [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 09 03:48:32 devstack cinder-volume[86757]: WARNING stevedore.named [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 09 03:48:32 devstack cinder-volume[86757]: WARNING castellan.key_manager [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 03:48:32 devstack cinder-volume[86757]: WARNING cinder.keymgr.conf_key_mgr [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 03:48:32 devstack cinder-volume[86757]: INFO cinder.volume.manager [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_db.sqlalchemy.engines [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86757) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 03:48:32 devstack cinder-volume[86757]: INFO oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Starting 1 workers
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Started child 86972 {{(pid=86757) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Full set of CONF: {{(pid=86757) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] ******************************************************************************** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Configuration options gathered from: {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] ================================================================================ {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] allow_availability_zone_fallback = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] allow_compression_on_image_upload = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86972]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] allowed_direct_url_schemes     = [] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] api_rate_limit                 = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] auth_strategy                  = keystone {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_availability_zone      = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_host                   = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_name                   = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_stats_polling_interval = 60 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backup_api_class               = cinder.backup.api.API {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backup_name_template           = backup-%s {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backup_use_same_host           = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backup_use_temp_snapshot       = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] chap_password                  = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] chap_username                  =  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cinder_internal_tenant_project_id = ce36118a21274cf9ac4da31fab3d5148 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cinder_internal_tenant_user_id = d74b4192761942c0948bec51cab90b86 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cluster                        = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] compression_format             = gzip {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] config_dir                     = [] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] config_source                  = [] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] control_exchange               = openstack {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] debug                          = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] default_availability_zone      = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] default_group_type             = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] default_volume_type            = QuobyteHD {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] disk_geometry                  = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] driver_client_cert             = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] driver_client_cert_key         = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] driver_data_namespace          = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] driver_ssl_cert_path           = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] driver_ssl_cert_verify         = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] driver_use_ssl                 = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] enable_new_services            = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] enable_unsupported_driver      = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] enforce_multipath_for_image_xfer = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] filter_function                = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance_api_insecure            = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance_api_servers             = ['http://192.168.122.155/image'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance_api_ssl_compression     = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance_ca_certificates_file    = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance_certfile                = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance_keyfile                 = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance_num_retries             = 3 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance_request_timeout         = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] goodness_function              = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] graceful_shutdown_timeout      = 5 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] group_api_class                = cinder.group.api.API {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] host                           = devstack {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] image_compress_on_upload       = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] image_conversion_address_space_limit = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] image_conversion_cpu_limit     = 60 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] image_conversion_disable       = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] image_upload_use_cinder_backend = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] image_upload_use_internal_tenant = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] image_volume_cache_enabled     = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] image_volume_cache_max_count   = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] image_volume_cache_max_size_gb = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] init_host_max_objects_retrieval = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] iscsi_target_flags             =  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] iscsi_write_cache              = on {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] iser_helper                    = tgtadm {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] iser_ip_address                = 192.168.122.155 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] iser_port                      = 3260 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] log_color                      = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] log_config_append              = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] log_dir                        = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] log_file                       = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] log_options                    = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] log_rotate_interval            = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] log_rotate_interval_type       = days {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] log_rotation_type              = none {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] max_age                        = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] max_logfile_count              = 30 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] max_logfile_size_mb            = 200 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] max_over_subscription_ratio    = 20.0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] message_reap_interval          = 86400 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] message_ttl                    = 2592000 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] migration_create_volume_timeout_secs = 300 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] monkey_patch                   = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] monkey_patch_modules           = [] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] my_ip                          = 192.168.122.155 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] no_snapshot_gb_quota           = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] num_iser_scan_tries            = 3 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] num_shell_tries                = 3 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] num_volume_device_scan_tries   = 3 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] nvmeof_conn_info_version       = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] nvmet_ns_id                    = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] nvmet_port_id                  = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] osapi_max_limit                = 1000 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] osapi_volume_ext_list          = [] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] osapi_volume_listen_port       = 8776 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] osapi_volume_use_ssl           = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] osapi_volume_workers           = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 09 03:48:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86972) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] per_volume_size_limit          = -1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] periodic_fuzzy_delay           = 60 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] periodic_interval              = 60 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] public_endpoint                = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] publish_errors                 = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] quota_backup_gigabytes         = 1000 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] quota_backups                  = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] quota_gigabytes                = 1000 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] quota_groups                   = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] quota_snapshots                = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] quota_volumes                  = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] rate_limit_burst               = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] rate_limit_except_level        = CRITICAL {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] rate_limit_interval            = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] reinit_driver_count            = 3 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] replication_device             = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] report_discard_supported       = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] report_interval                = 120 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] reservation_clean_interval     = 86400 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] reservation_expire             = 86400 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] reserved_image_namespaces      = [] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] reserved_percentage            = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] rpc_response_timeout           = 120 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] run_external_periodic_tasks    = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] scst_target_driver             = iscsi {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] scst_target_iqn_name           = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] service_down_time              = 720 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] shell_completion               = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] snapshot_name_template         = snapshot-%s {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] split_loggers                  = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] state_path                     = /opt/stack/data/cinder {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] storage_availability_zone      = nova {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] storage_protocol               = iSCSI {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] syslog_log_facility            = LOG_USER {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] target_helper                  = lioadm {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] target_ip_address              = 192.168.122.155 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] target_port                    = 3260 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] target_protocol                = iscsi {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] target_secondary_ip_addresses  = [] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] trace_flags                    = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] transport_url                  = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] until_refresh                  = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] use_chap_auth                  = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] use_default_quota_class        = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] use_journal                    = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] use_json                       = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] use_multipath_for_image_xfer   = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] use_stderr                     = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] use_syslog                     = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] verify_glance_signatures       = enabled {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] volume_api_class               = cinder.volume.api.API {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] volume_backend_name            = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] volume_clear                   = zero {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] volume_clear_ionice            = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] volume_clear_size              = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] volume_copy_bps_limit          = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] volume_dd_blocksize            = 1M {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] volume_name_template           = volume-%s {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] volume_service_inithost_offload = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] volume_usage_audit_period      = month {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] zoning_mode                    = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_concurrency.disable_process_locking = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.auth_section = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.auth_type   = password {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.auth_version = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.cache       = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.certfile    = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.include_service_catalog = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.insecure    = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.interface   = public {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.keyfile     = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_password = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcache_username = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.region_name = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.service_type = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.155/identity {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.backend                  = dogpile.cache.null {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.backend_argument         = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.backend_expiration_time  = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.config_prefix            = cache.oslo {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.debug_cache_backend      = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.enable_retry_client      = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.enable_socket_keepalive  = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.enabled                  = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.expiration_time          = 600 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.hashclient_retry_attempts = 2 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.memcache_dead_retry      = 300 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.memcache_sasl_enabled    = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.password                 = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.proxies                  = [] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.redis_db                 = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.redis_server             = localhost:6379 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.retry_attempts           = 2 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86972) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 09 03:48:32 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.quobyte [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.retry_delay              = 0.0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.socket_keepalive_count   = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.socket_keepalive_idle    = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.socket_keepalive_interval = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.socket_timeout           = 1.0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.tls_allowed_ciphers      = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.quobyte [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 09 03:48:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Running cmd (subprocess): mount.quobyte {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.tls_cafile               = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.tls_certfile             = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.tls_enabled              = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.tls_keyfile              = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cache.username                 = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] coordination.backend_url       = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.asyncio_connection    = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.asyncio_slave_connection = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.backend               = sqlalchemy {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.connection            = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.connection_debug      = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.connection_parameters =  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.connection_recycle_time = 3600 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.connection_trace      = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.db_inc_retry_interval = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.db_max_retries        = 20 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.db_max_retry_interval = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.db_retry_interval     = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.max_overflow          = 50 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.max_pool_size         = 5 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.max_retries           = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.mysql_wsrep_sync_wait = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.pool_timeout          = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.retry_interval        = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.slave_connection      = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.sqlite_synchronous    = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.synchronous_reader    = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] database.use_db_reconnect      = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_tracing.insecure = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler.connection_string     = messaging:// {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler.enabled               = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler.es_doc_type           = notification {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler.es_scroll_size        = 10000 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler.es_scroll_time        = 2m {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler.filter_error_trace    = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler.hmac_keys             = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler.sentinel_service_name = mymaster {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler.socket_timeout        = 0.1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler.trace_requests        = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler.trace_sqlalchemy      = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler_jaeger.process_tags   = {} {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler_jaeger.service_name_prefix = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] profiler_otlp.service_name_prefix = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_policy.enforce_new_defaults = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_policy.policy_default_rule = default {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] privsep_osbrick.group          = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] privsep_osbrick.helper_command = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] privsep_osbrick.user           = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cinder_sys_admin.group         = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cinder_sys_admin.helper_command = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] cinder_sys_admin.user          = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] service_user.auth_section      = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] service_user.auth_type         = password {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] service_user.cafile            = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] service_user.certfile          = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] service_user.collect_timing    = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] service_user.insecure          = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] service_user.keyfile           = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] service_user.send_service_user_token = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] service_user.split_loggers     = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] service_user.timeout           = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] service_user.tls_ciphers       = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] service_user.tls_min_version   = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance.auth_section            = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance.auth_type               = password {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance.certfile                = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance.collect_timing          = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance.insecure                = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance.keyfile                 = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance.region_name             = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance.split_loggers           = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance.timeout                 = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance.tls_ciphers             = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] glance.tls_min_version         = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.backend_availability_zone = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.chap_password = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.chap_username =  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.disk_geometry = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.driver_client_cert = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.driver_client_cert_key = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.driver_data_namespace = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.driver_use_ssl = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.extra_capabilities = {} {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.filter_function = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.goodness_function = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.iscsi_target_flags =  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.iscsi_write_cache = on {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.iser_ip_address = 192.168.122.155 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.iser_port     = 3260 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.nas_host      =  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.nas_login     = admin {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.nas_mount_options = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.nas_password  = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.nas_private_key =  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.nas_share_path =  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.num_shell_tries = 3 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.quobyte_volume_url = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.replication_device = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.report_discard_supported = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.reserved_percentage = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.target_helper = tgtadm {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.target_ip_address = 192.168.122.155 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.target_port   = 3260 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.target_protocol = iscsi {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.trace_flags   = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.unique_fqdn_network = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.use_chap_auth = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.volume_backend_name = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.volume_clear  = zero {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.volume_clear_ionice = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.volume_clear_size = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_reports.file_event_handler = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_reports.log_dir           = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.backend_availability_zone = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.backend_host         = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.chap_password        = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.chap_username        = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.disk_geometry        = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.driver_client_cert   = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.driver_data_namespace = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.extra_capabilities   = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.filter_function      = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.goodness_function    = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.iser_helper          = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.iser_ip_address      = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.iser_port            = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.nas_host             = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.nas_login            = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.nas_mount_options    = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.nas_password         = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.nas_private_key      = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.nas_share_path       = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.num_shell_tries      = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.replication_device   = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.report_discard_supported = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.reserved_percentage  = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.scst_target_driver   = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.storage_protocol     = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.target_helper        = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.target_ip_address    = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.target_port          = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.target_prefix        = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] CMD "mount.quobyte" returned: 1 in 0.141s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:48:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:48:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:48:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.target_protocol      = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.trace_flags          = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.use_chap_auth        = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.volume_clear         = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.volume_clear_size    = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86972]: INFO cinder.volume.drivers.quobyte [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc ...
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 -c /etc/quobyte/client-cinder.cfg {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] QuobyteHD.volumes_dir          = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_notifications.driver = [] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_notifications.retry = -1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] key_manager.fixed_key          = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.barbican_api_version  = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.barbican_endpoint     = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.barbican_endpoint_type = public {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.barbican_region_name  = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.cafile                = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.certfile              = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.collect_timing        = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.insecure              = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.keyfile               = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.number_of_retries     = 60 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.retry_delay           = 1 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.send_service_user_token = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack sudo[86978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 -c /etc/quobyte/client-cinder.cfg
Sep 09 03:48:32 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.split_loggers         = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.timeout               = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.tls_ciphers           = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.tls_min_version       = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.verify_ssl            = True {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican.verify_ssl_path       = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican_service_user.auth_section = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican_service_user.auth_type = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican_service_user.cafile   = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican_service_user.certfile = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican_service_user.collect_timing = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican_service_user.insecure = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican_service_user.keyfile  = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican_service_user.split_loggers = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican_service_user.timeout  = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican_service_user.tls_ciphers = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] barbican_service_user.tls_min_version = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.approle_role_id          = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.approle_secret_id        = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.auth_method              = approle {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.auth_path                = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.kv_mountpoint            = secret {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.kv_path                  = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.kv_version               = 2 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.namespace                = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.root_token_id            = **** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.ssl_ca_crt_file          = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.timeout                  = 60.0 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.token_file               = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.token_role               = None {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.use_ssl                  = False {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:32 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] ******************************************************************************** {{(pid=86757) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 09 03:48:32 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root
Sep 09 03:48:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.379s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:48:32 devstack cinder-volume[86972]: INFO cinder.volume.drivers.quobyte [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc succeeded
Sep 09 03:48:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:48:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.395s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:48:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:48:32 devstack sudo[87047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:48:32 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:48:33 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.240s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:48:33 devstack cinder-volume[86972]: INFO cinder.volume.driver [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Driver hasn't implemented _init_vendor_properties()
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG cinder.volume.driver [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.423496246338, 'free_capacity_gb': 1773.423496246338, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86972) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG oslo_db.sqlalchemy.engines [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writer thread running {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG cinder.db.api [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Building query based on filter {{(pid=86972) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86972) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 09 03:48:33 devstack cinder-volume[86972]: INFO cinder.keymgr.migration [None req-48b40157-5f1d-43b9-873f-d5a30486784b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:48:33 devstack sudo[87050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:48:33 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:48:33 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.243s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:48:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Driver initialization completed successfully.
Sep 09 03:48:33 devstack cinder-volume[86972]: INFO cinder.manager [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Initiating service 3 cleanup
Sep 09 03:48:33 devstack cinder-volume[86972]: INFO cinder.manager [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Service 3 cleanup completed.
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG cinder.service [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Creating RPC server for service cinder-volume {{(pid=86972) start /opt/stack/cinder/cinder/service.py:231}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG cinder.service [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86972) start /opt/stack/cinder/cinder/service.py:237}}
Sep 09 03:48:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:48:33 devstack sudo[87054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:48:33 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:48:33 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root
Sep 09 03:48:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.248s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:48:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fd52de2f-8416-492f-bd00-75dedc1c8227 None None] Driver post RPC initialization completed successfully.
Sep 09 03:48:38 devstack cinder-volume[86757]: INFO oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Caught SIGTERM, stopping children
Sep 09 03:48:38 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Acquiring lock "singleton_lock" {{(pid=86757) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 03:48:38 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Acquired lock "singleton_lock" {{(pid=86757) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 03:48:38 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Releasing lock "singleton_lock" {{(pid=86757) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 03:48:38 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Stop services. {{(pid=86757) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 09 03:48:38 devstack cinder-volume[86757]: DEBUG oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Killing children. {{(pid=86757) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 09 03:48:38 devstack cinder-volume[86757]: INFO oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Waiting on 1 children to exit
Sep 09 03:48:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Acquiring lock "singleton_lock" {{(pid=86972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 03:48:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Acquired lock "singleton_lock" {{(pid=86972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 03:48:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Releasing lock "singleton_lock" {{(pid=86972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 03:48:41 devstack cinder-volume[86972]: WARNING amqp [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 09 03:48:41 devstack cinder-volume[86972]: WARNING amqp [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 09 03:48:41 devstack cinder-volume[86757]: INFO oslo_service.backend._eventlet.service [None req-a2527530-b197-4f55-97cd-58bdd45cd333 None None] Child 86972 exited with status 0
Sep 09 03:48:42 devstack cinder-volume[87254]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 09 03:48:42 devstack cinder-volume[87254]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 09 03:48:42 devstack cinder-volume[87254]: we strongly recommend against using it for new projects.
Sep 09 03:48:42 devstack cinder-volume[87254]: If you are already using Eventlet, we recommend migrating to a different
Sep 09 03:48:42 devstack cinder-volume[87254]: framework.  For more detail see
Sep 09 03:48:42 devstack cinder-volume[87254]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 09 03:48:42 devstack cinder-volume[87254]:   import eventlet  # noqa
Sep 09 03:48:45 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 03:48:45 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 03:48:45 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 03:48:46 devstack cinder-volume[87254]: INFO dbcounter [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] Registered counter for database cinder
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_db.sqlalchemy.engines [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87254) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG dbcounter [-] [87254] Writer thread running {{(pid=87254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 09 03:48:46 devstack cinder-volume[87254]: INFO cinder.rpc [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 09 03:48:46 devstack cinder-volume[87254]: INFO cinder.rpc [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_db.sqlalchemy.engines [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87254) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 03:48:46 devstack cinder-volume[87254]: INFO cinder.volume.manager [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] Determined volume DB was empty at startup.
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG cinder.volume.manager [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87254) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 09 03:48:46 devstack cinder-volume[87254]: WARNING stevedore.named [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 09 03:48:46 devstack cinder-volume[87254]: WARNING castellan.key_manager [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 03:48:46 devstack cinder-volume[87254]: WARNING cinder.keymgr.conf_key_mgr [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 03:48:46 devstack cinder-volume[87254]: INFO cinder.volume.manager [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_db.sqlalchemy.engines [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87254) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 03:48:46 devstack cinder-volume[87254]: INFO oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] Starting 1 workers
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] Started child 87558 {{(pid=87254) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] Full set of CONF: {{(pid=87254) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] ******************************************************************************** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] Configuration options gathered from: {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] ================================================================================ {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] allow_availability_zone_fallback = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] allow_compression_on_image_upload = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87558]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] allowed_direct_url_schemes     = [] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] api_rate_limit                 = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] auth_strategy                  = keystone {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_availability_zone      = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_host                   = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_name                   = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_stats_polling_interval = 60 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backup_api_class               = cinder.backup.api.API {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backup_name_template           = backup-%s {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backup_use_same_host           = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backup_use_temp_snapshot       = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] chap_password                  = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] chap_username                  =  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cinder_internal_tenant_project_id = ce36118a21274cf9ac4da31fab3d5148 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cinder_internal_tenant_user_id = d74b4192761942c0948bec51cab90b86 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cluster                        = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] compression_format             = gzip {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] config_dir                     = [] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] config_source                  = [] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] control_exchange               = openstack {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] debug                          = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] default_availability_zone      = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] default_group_type             = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] default_volume_type            = QuobyteHD {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] disk_geometry                  = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] driver_client_cert             = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] driver_client_cert_key         = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] driver_data_namespace          = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] driver_ssl_cert_path           = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] driver_ssl_cert_verify         = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] driver_use_ssl                 = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] enable_new_services            = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] enable_unsupported_driver      = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] enforce_multipath_for_image_xfer = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] filter_function                = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance_api_insecure            = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance_api_servers             = ['http://192.168.122.155/image'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance_api_ssl_compression     = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance_ca_certificates_file    = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance_certfile                = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance_keyfile                 = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance_num_retries             = 3 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance_request_timeout         = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] goodness_function              = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] graceful_shutdown_timeout      = 5 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] group_api_class                = cinder.group.api.API {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] host                           = devstack {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] image_compress_on_upload       = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] image_conversion_address_space_limit = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] image_conversion_cpu_limit     = 60 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] image_conversion_disable       = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] image_upload_use_cinder_backend = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] image_upload_use_internal_tenant = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] image_volume_cache_enabled     = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] image_volume_cache_max_count   = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] image_volume_cache_max_size_gb = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] init_host_max_objects_retrieval = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] iscsi_target_flags             =  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] iscsi_write_cache              = on {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] iser_helper                    = tgtadm {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] iser_ip_address                = 192.168.122.155 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] iser_port                      = 3260 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] log_color                      = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] log_config_append              = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] log_dir                        = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] log_file                       = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] log_options                    = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] log_rotate_interval            = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] log_rotate_interval_type       = days {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] log_rotation_type              = none {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] max_age                        = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] max_logfile_count              = 30 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] max_logfile_size_mb            = 200 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] max_over_subscription_ratio    = 20.0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] message_reap_interval          = 86400 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87558) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] message_ttl                    = 2592000 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] migration_create_volume_timeout_secs = 300 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] monkey_patch                   = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] monkey_patch_modules           = [] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] my_ip                          = 192.168.122.155 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] no_snapshot_gb_quota           = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] num_iser_scan_tries            = 3 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] num_shell_tries                = 3 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] num_volume_device_scan_tries   = 3 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] nvmeof_conn_info_version       = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] nvmet_ns_id                    = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] nvmet_port_id                  = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] osapi_max_limit                = 1000 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] osapi_volume_ext_list          = [] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] osapi_volume_listen_port       = 8776 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] osapi_volume_use_ssl           = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] osapi_volume_workers           = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] per_volume_size_limit          = -1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] periodic_fuzzy_delay           = 60 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] periodic_interval              = 60 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] public_endpoint                = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] publish_errors                 = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] quota_backup_gigabytes         = 1000 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] quota_backups                  = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] quota_gigabytes                = 1000 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] quota_groups                   = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] quota_snapshots                = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] quota_volumes                  = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] rate_limit_burst               = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] rate_limit_except_level        = CRITICAL {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] rate_limit_interval            = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] reinit_driver_count            = 3 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] replication_device             = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] report_discard_supported       = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] report_interval                = 120 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] reservation_clean_interval     = 86400 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] reservation_expire             = 86400 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] reserved_image_namespaces      = [] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] reserved_percentage            = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] rpc_response_timeout           = 120 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] run_external_periodic_tasks    = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] scst_target_driver             = iscsi {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] scst_target_iqn_name           = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] service_down_time              = 720 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] shell_completion               = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] snapshot_name_template         = snapshot-%s {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] split_loggers                  = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] state_path                     = /opt/stack/data/cinder {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] storage_availability_zone      = nova {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] storage_protocol               = iSCSI {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] syslog_log_facility            = LOG_USER {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] target_helper                  = lioadm {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] target_ip_address              = 192.168.122.155 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] target_port                    = 3260 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] target_protocol                = iscsi {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] target_secondary_ip_addresses  = [] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] trace_flags                    = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] transport_url                  = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] until_refresh                  = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] use_chap_auth                  = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] use_default_quota_class        = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] use_journal                    = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] use_json                       = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] use_multipath_for_image_xfer   = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] use_stderr                     = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] use_syslog                     = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] verify_glance_signatures       = enabled {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] volume_api_class               = cinder.volume.api.API {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] volume_backend_name            = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] volume_clear                   = zero {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] volume_clear_ionice            = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] volume_clear_size              = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] volume_copy_bps_limit          = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] volume_dd_blocksize            = 1M {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] volume_name_template           = volume-%s {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] volume_service_inithost_offload = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] volume_usage_audit_period      = month {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] zoning_mode                    = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_concurrency.disable_process_locking = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.auth_section = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.auth_type   = password {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.auth_version = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.cache       = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.certfile    = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.include_service_catalog = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.insecure    = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.interface   = public {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.keyfile     = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_password = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcache_username = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.region_name = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.service_type = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.155/identity {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.backend                  = dogpile.cache.null {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.backend_argument         = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.backend_expiration_time  = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.config_prefix            = cache.oslo {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.debug_cache_backend      = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.enable_retry_client      = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.enable_socket_keepalive  = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.enabled                  = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87558) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.expiration_time          = 600 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.quobyte [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.hashclient_retry_attempts = 2 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.memcache_dead_retry      = 300 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.quobyte [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.memcache_sasl_enabled    = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Running cmd (subprocess): mount.quobyte {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.password                 = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.proxies                  = [] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.redis_db                 = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.redis_server             = localhost:6379 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.retry_attempts           = 2 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.retry_delay              = 0.0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.socket_keepalive_count   = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.socket_keepalive_idle    = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.socket_keepalive_interval = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.socket_timeout           = 1.0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.tls_allowed_ciphers      = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.tls_cafile               = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.tls_certfile             = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.tls_enabled              = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.tls_keyfile              = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cache.username                 = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] coordination.backend_url       = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.asyncio_connection    = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.asyncio_slave_connection = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.backend               = sqlalchemy {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.connection            = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.connection_debug      = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.connection_parameters =  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.connection_recycle_time = 3600 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.connection_trace      = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.db_inc_retry_interval = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.db_max_retries        = 20 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.db_max_retry_interval = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.db_retry_interval     = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.max_overflow          = 50 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.max_pool_size         = 5 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.max_retries           = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.mysql_wsrep_sync_wait = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.pool_timeout          = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.retry_interval        = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.slave_connection      = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.sqlite_synchronous    = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.synchronous_reader    = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] database.use_db_reconnect      = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_tracing.insecure = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler.connection_string     = messaging:// {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler.enabled               = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler.es_doc_type           = notification {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler.es_scroll_size        = 10000 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler.es_scroll_time        = 2m {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler.filter_error_trace    = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler.hmac_keys             = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler.sentinel_service_name = mymaster {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler.socket_timeout        = 0.1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler.trace_requests        = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler.trace_sqlalchemy      = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler_jaeger.process_tags   = {} {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler_jaeger.service_name_prefix = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] profiler_otlp.service_name_prefix = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_policy.enforce_new_defaults = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_policy.policy_default_rule = default {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] privsep_osbrick.group          = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] privsep_osbrick.helper_command = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] privsep_osbrick.user           = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cinder_sys_admin.group         = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cinder_sys_admin.helper_command = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] cinder_sys_admin.user          = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] service_user.auth_section      = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] service_user.auth_type         = password {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] service_user.cafile            = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] service_user.certfile          = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] service_user.collect_timing    = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] service_user.insecure          = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] service_user.keyfile           = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] service_user.send_service_user_token = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] service_user.split_loggers     = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] service_user.timeout           = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] service_user.tls_ciphers       = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] service_user.tls_min_version   = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance.auth_section            = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance.auth_type               = password {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance.certfile                = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance.collect_timing          = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance.insecure                = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance.keyfile                 = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance.region_name             = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance.split_loggers           = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance.timeout                 = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance.tls_ciphers             = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] glance.tls_min_version         = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.backend_availability_zone = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.chap_password = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.chap_username =  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.disk_geometry = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.driver_client_cert = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.driver_client_cert_key = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.driver_data_namespace = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack quobyte-client[87559]: Reading configuration file: /etc/quobyte/client.cfg
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.driver_use_ssl = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.extra_capabilities = {} {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack quobyte-client[87559]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.filter_function = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.goodness_function = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.iscsi_target_flags =  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.iscsi_write_cache = on {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.iser_ip_address = 192.168.122.155 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.iser_port     = 3260 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.nas_host      =  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.nas_login     = admin {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.nas_mount_options = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.nas_password  = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.nas_private_key =  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.nas_share_path =  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.num_shell_tries = 3 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.quobyte_volume_url = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.replication_device = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.report_discard_supported = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.reserved_percentage = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.target_helper = tgtadm {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.target_ip_address = 192.168.122.155 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.target_port   = 3260 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.target_protocol = iscsi {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.trace_flags   = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.unique_fqdn_network = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.use_chap_auth = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.volume_backend_name = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.volume_clear  = zero {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.volume_clear_ionice = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.volume_clear_size = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_reports.file_event_handler = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_reports.log_dir           = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.backend_availability_zone = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.backend_host         = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.chap_password        = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.chap_username        = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.disk_geometry        = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.driver_client_cert   = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.driver_data_namespace = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack sudo[87561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.extra_capabilities   = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.filter_function      = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.goodness_function    = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.iser_helper          = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.iser_ip_address      = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.iser_port            = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.nas_host             = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.nas_login            = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.nas_mount_options    = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.nas_password         = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.nas_private_key      = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.nas_share_path       = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.num_shell_tries      = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.replication_device   = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.report_discard_supported = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.reserved_percentage  = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.scst_target_driver   = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.storage_protocol     = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.target_helper        = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.target_ip_address    = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.target_port          = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.target_prefix        = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.target_protocol      = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.trace_flags          = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.use_chap_auth        = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:46 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.volume_clear         = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.volume_clear_size    = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] QuobyteHD.volumes_dir          = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_notifications.driver = [] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_notifications.retry = -1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] key_manager.fixed_key          = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.barbican_api_version  = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.barbican_endpoint     = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.barbican_endpoint_type = public {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.barbican_region_name  = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.cafile                = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.certfile              = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.collect_timing        = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.insecure              = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.keyfile               = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.number_of_retries     = 60 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.retry_delay           = 1 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.send_service_user_token = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.split_loggers         = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.timeout               = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.tls_ciphers           = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.tls_min_version       = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.verify_ssl            = True {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican.verify_ssl_path       = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican_service_user.auth_section = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican_service_user.auth_type = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican_service_user.cafile   = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican_service_user.certfile = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican_service_user.collect_timing = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican_service_user.insecure = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican_service_user.keyfile  = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican_service_user.split_loggers = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican_service_user.timeout  = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican_service_user.tls_ciphers = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] barbican_service_user.tls_min_version = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.approle_role_id          = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.approle_secret_id        = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.auth_method              = approle {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.auth_path                = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.kv_mountpoint            = secret {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.kv_path                  = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.kv_version               = 2 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.namespace                = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.root_token_id            = **** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.ssl_ca_crt_file          = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.timeout                  = 60.0 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.token_file               = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.token_role               = None {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.use_ssl                  = False {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 03:48:47 devstack cinder-volume[87254]: DEBUG oslo_service.backend._eventlet.service [None req-52558f0c-127c-42f8-a225-bbce8c922b54 None None] ******************************************************************************** {{(pid=87254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 09 03:48:47 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.240s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:48:47 devstack cinder-volume[87558]: INFO cinder.volume.driver [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Driver hasn't implemented _init_vendor_properties()
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG cinder.volume.driver [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.423496246338, 'free_capacity_gb': 1773.423496246338, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87558) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG oslo_db.sqlalchemy.engines [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87558) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writer thread running {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG cinder.db.api [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Building query based on filter {{(pid=87558) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87558) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:48:47 devstack cinder-volume[87558]: INFO cinder.keymgr.migration [None req-862adeb9-1d0b-48ac-80c5-c6c09a6699a4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 09 03:48:47 devstack sudo[87571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:48:47 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:48:47 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.232s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:48:47 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Driver initialization completed successfully.
Sep 09 03:48:47 devstack cinder-volume[87558]: INFO cinder.manager [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Initiating service 3 cleanup
Sep 09 03:48:47 devstack cinder-volume[87558]: INFO cinder.manager [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Service 3 cleanup completed.
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG cinder.service [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Creating RPC server for service cinder-volume {{(pid=87558) start /opt/stack/cinder/cinder/service.py:231}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG cinder.service [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87558) start /opt/stack/cinder/cinder/service.py:237}}
Sep 09 03:48:47 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:48:47 devstack sudo[87582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:48:47 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:48:47 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root
Sep 09 03:48:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.260s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:48:47 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9c368884-f39b-4b16-8f4e-42be417f59c5 None None] Driver post RPC initialization completed successfully.
Sep 09 03:48:56 devstack cinder-volume[87254]: DEBUG dbcounter [-] [87254] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:48:57 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:48:57 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=2 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:49:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:49:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 6 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 03:49:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 03:49:44 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Flow 'volume_create_manager' (99f32a49-dfd6-4bc6-b059-e9d82c938921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe95675-6bfb-4b5f-8b5b-afafbeec13da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe95675-6bfb-4b5f-8b5b-afafbeec13da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2120363916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea05a71-536d-49e1-92db-07ba058c8f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9895bded3d6e41588f6e5573acffbcf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:45Z,use_quota=True,user_id='fcdfce6091c14181a7ed8417f3e167cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eebe58-9430-4d36-8367-d022ece51e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eebe58-9430-4d36-8367-d022ece51e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296c7af9-d958-4418-b9f5-11af2666189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296c7af9-d958-4418-b9f5-11af2666189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea05a71-536d-49e1-92db-07ba058c8f1d', 'volume_name': 'volume-bea05a71-536d-49e1-92db-07ba058c8f1d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0db070-1e06-4921-b182-d55c5729c815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0db070-1e06-4921-b182-d55c5729c815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ea3f1b-0834-4717-bd88-3aece365466c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:49:45 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Volume bea05a71-536d-49e1-92db-07ba058c8f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea05a71-536d-49e1-92db-07ba058c8f1d', 'volume_size': 1}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2120363916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea05a71-536d-49e1-92db-07ba058c8f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9895bded3d6e41588f6e5573acffbcf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:45Z,use_quota=True,user_id='fcdfce6091c14181a7ed8417f3e167cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Creating volume bea05a71-536d-49e1-92db-07ba058c8f1d {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:49:45 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:49:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bea05a71-536d-49e1-92db-07ba058c8f1d 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:49:45 devstack sudo[88170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bea05a71-536d-49e1-92db-07ba058c8f1d 1073741824
Sep 09 03:49:45 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:49:46 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root
Sep 09 03:49:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bea05a71-536d-49e1-92db-07ba058c8f1d 1073741824" returned: 0 in 1.026s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:49:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bea05a71-536d-49e1-92db-07ba058c8f1d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:49:46 devstack sudo[88494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bea05a71-536d-49e1-92db-07ba058c8f1d
Sep 09 03:49:46 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:49:47 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root
Sep 09 03:49:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bea05a71-536d-49e1-92db-07ba058c8f1d" returned: 0 in 0.862s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:49:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:49:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:49:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ea3f1b-0834-4717-bd88-3aece365466c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea05a71-536d-49e1-92db-07ba058c8f1d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:49:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf1d2d0-b9a5-40a0-bd24-e2412df25f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:49:47 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Volume volume-bea05a71-536d-49e1-92db-07ba058c8f1d (bea05a71-536d-49e1-92db-07ba058c8f1d): created successfully
Sep 09 03:49:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf1d2d0-b9a5-40a0-bd24-e2412df25f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:49:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Flow 'volume_create_manager' (99f32a49-dfd6-4bc6-b059-e9d82c938921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:49:47 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4330c209-ae77-4269-81b8-8a28f1acff29 tempest-TaggedAttachmentsTest-121214804 None] Created volume successfully.
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Flow 'volume_create_manager' (9888dc87-70a2-4553-aae3-aecfdf96fcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d3bb2d-7e27-46c1-a566-af0098720a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d3bb2d-7e27-46c1-a566-af0098720a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-23409058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f24b3e8-2243-4f36-8ba5-94d1233463f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae930c1ae61247e58410dc36f96337a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:49Z,use_quota=True,user_id='24fdd70b14164380bd66838018af170e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0020b8c0-05d5-471a-92f7-2f9c9330b220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0020b8c0-05d5-471a-92f7-2f9c9330b220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6758a1-3783-430b-98df-0b3fa148a3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6758a1-3783-430b-98df-0b3fa148a3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f24b3e8-2243-4f36-8ba5-94d1233463f0', 'volume_name': 'volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0428d085-cd7c-4cd8-9373-08715f2f518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0428d085-cd7c-4cd8-9373-08715f2f518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da036038-caef-441b-8ed0-df2887f1ceec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:49:49 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Volume 8f24b3e8-2243-4f36-8ba5-94d1233463f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0', 'volume_size': 1}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-23409058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f24b3e8-2243-4f36-8ba5-94d1233463f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae930c1ae61247e58410dc36f96337a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:49Z,use_quota=True,user_id='24fdd70b14164380bd66838018af170e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Creating volume 8f24b3e8-2243-4f36-8ba5-94d1233463f0 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:49:49 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:49:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:49:49 devstack sudo[88502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0 1073741824
Sep 09 03:49:49 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:49:50 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root
Sep 09 03:49:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0 1073741824" returned: 0 in 0.885s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:49:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:49:50 devstack sudo[88507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0
Sep 09 03:49:50 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:49:51 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root
Sep 09 03:49:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0" returned: 0 in 0.608s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:49:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:49:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:49:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da036038-caef-441b-8ed0-df2887f1ceec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:49:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c326fb1-ca68-4f78-b5ae-fcf0f2c34595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:49:51 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Volume volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0 (8f24b3e8-2243-4f36-8ba5-94d1233463f0): created successfully
Sep 09 03:49:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c326fb1-ca68-4f78-b5ae-fcf0f2c34595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:49:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Flow 'volume_create_manager' (9888dc87-70a2-4553-aae3-aecfdf96fcdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:49:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-1852182a-8167-4bcb-b8ad-b2e5d5663946 tempest-DeleteServersTestJSON-619663767 None] Created volume successfully.
Sep 09 03:49:58 devstack cinder-volume[87558]: WARNING py.warnings [req-122658e5-bbf1-47ff-89c6-ced3c7368051 req-0ecde9b5-3249-4be2-bcb6-496c0c2236ea tempest-DeleteServersTestJSON-619663767 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Sep 09 03:49:58 devstack cinder-volume[87558]:   .first()
Sep 09 03:49:58 devstack cinder-volume[87558]: 
Sep 09 03:49:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-122658e5-bbf1-47ff-89c6-ced3c7368051 req-0ecde9b5-3249-4be2-bcb6-496c0c2236ea tempest-DeleteServersTestJSON-619663767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:49:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-122658e5-bbf1-47ff-89c6-ced3c7368051 req-0ecde9b5-3249-4be2-bcb6-496c0c2236ea tempest-DeleteServersTestJSON-619663767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:49:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-122658e5-bbf1-47ff-89c6-ced3c7368051 req-0ecde9b5-3249-4be2-bcb6-496c0c2236ea tempest-DeleteServersTestJSON-619663767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:49:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-122658e5-bbf1-47ff-89c6-ced3c7368051 req-0ecde9b5-3249-4be2-bcb6-496c0c2236ea tempest-DeleteServersTestJSON-619663767 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2ecba27-55c2-44c7-8db2-446047c34c8a', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 03:49:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-122658e5-bbf1-47ff-89c6-ced3c7368051 req-0ecde9b5-3249-4be2-bcb6-496c0c2236ea tempest-DeleteServersTestJSON-619663767 None] attachment_update completed successfully.
Sep 09 03:50:06 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-9386b97a-caee-4902-9c83-2761de6e13ba req-6e6af312-89ec-4dd1-91fc-7e0c864e21a5 tempest-DeleteServersTestJSON-619663767 None] Terminate volume connection completed successfully.
Sep 09 03:50:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-9386b97a-caee-4902-9c83-2761de6e13ba req-6e6af312-89ec-4dd1-91fc-7e0c864e21a5 tempest-DeleteServersTestJSON-619663767 None] Deleting attachment e2ecba27-55c2-44c7-8db2-446047c34c8a. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 03:50:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Acquiring lock "cinder-8f24b3e8-2243-4f36-8ba5-94d1233463f0-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:50:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Lock "cinder-8f24b3e8-2243-4f36-8ba5-94d1233463f0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:50:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Acquiring lock "cinder-quobyte-8f24b3e8-2243-4f36-8ba5-94d1233463f0" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:50:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Lock "cinder-quobyte-8f24b3e8-2243-4f36-8ba5-94d1233463f0" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:50:08 devstack cinder-volume[87558]: INFO oslo.privsep.daemon [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3pv18qhp/privsep.sock']
Sep 09 03:50:08 devstack sudo[89219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3pv18qhp/privsep.sock
Sep 09 03:50:08 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:09 devstack cinder-volume[87558]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 09 03:50:09 devstack cinder-volume[87558]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 09 03:50:09 devstack cinder-volume[87558]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 09 03:50:09 devstack cinder-volume[87558]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 09 03:50:09 devstack cinder-volume[87558]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 09 03:50:09 devstack cinder-volume[87558]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 09 03:50:09 devstack cinder-volume[87558]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 09 03:50:09 devstack cinder-volume[87558]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 09 03:50:09 devstack cinder-volume[87558]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 09 03:50:10 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:10 devstack cinder-volume[87558]: INFO oslo.privsep.daemon [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Spawned new privsep daemon via rootwrap
Sep 09 03:50:10 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Accepted privsep connection to /tmp/tmp3pv18qhp/privsep.sock {{(pid=87558) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 09 03:50:10 devstack cinder-volume[87558]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 09 03:50:10 devstack cinder-volume[87558]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 09 03:50:10 devstack cinder-volume[87558]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 09 03:50:10 devstack cinder-volume[87558]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89225
Sep 09 03:50:10 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d338ada-81bd-4e8c-bd37-8c99df6404c5]: (2,) {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:50:10 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2a667c-e6eb-4736-95ba-708f2fde7dfa]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:50:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:10 devstack sudo[89229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0
Sep 09 03:50:10 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:10 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0" returned: 0 in 0.527s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:10 devstack sudo[89236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0
Sep 09 03:50:10 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:10 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8f24b3e8-2243-4f36-8ba5-94d1233463f0" returned: 0 in 0.311s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Lock "cinder-quobyte-8f24b3e8-2243-4f36-8ba5-94d1233463f0" released by "delete_volume" :: held 2.416s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:50:10 devstack cinder-volume[87558]: WARNING cinder.quota [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:50:10 devstack cinder-volume[87558]: WARNING cinder.quota [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:50:11 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Created reservations ['c9450264-701f-452a-a72b-e132b8e7cfc4', 'ea56aa0b-8615-42cd-a34e-fc005a32ba69', 'd9df5d9a-ab16-4fda-b26e-158d3ab3b204', '83aeb30f-3f8e-4891-9a4c-3d7e5808d5d5'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:50:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:50:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:50:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:11 devstack sudo[89240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:50:11 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:11 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.327s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:11 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:50:11 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Deleted volume successfully.
Sep 09 03:50:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-812ccccc-86a0-40a2-b807-4bc807fc91cc tempest-DeleteServersTestJSON-619663767 None] Lock "cinder-8f24b3e8-2243-4f36-8ba5-94d1233463f0-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Flow 'volume_create_manager' (36627cb6-db96-412e-9407-f1d02bf24839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172f9acc-d123-4a99-b06e-65a554fd5c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172f9acc-d123-4a99-b06e-65a554fd5c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2088784938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8975fd5-2649-4e21-bf68-ee6fe0e0a29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1221a30670e54bbcb80698a594e6c130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:16Z,use_quota=True,user_id='df0acdad6628427eabac22bceef94f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b6c3e9-cddb-421f-9581-c45a8f3547aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b6c3e9-cddb-421f-9581-c45a8f3547aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea2c5c3-26c5-4be6-b7f5-aca817b6075d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea2c5c3-26c5-4be6-b7f5-aca817b6075d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8975fd5-2649-4e21-bf68-ee6fe0e0a29d', 'volume_name': 'volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29884a4-33ea-44e9-af0c-56f979f8a9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29884a4-33ea-44e9-af0c-56f979f8a9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782f93f1-3246-469a-9e51-71fdb7eb53ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:16 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Volume b8975fd5-2649-4e21-bf68-ee6fe0e0a29d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d', 'volume_size': 1}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2088784938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8975fd5-2649-4e21-bf68-ee6fe0e0a29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1221a30670e54bbcb80698a594e6c130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:16Z,use_quota=True,user_id='df0acdad6628427eabac22bceef94f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Creating volume b8975fd5-2649-4e21-bf68-ee6fe0e0a29d {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:50:16 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:50:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:16 devstack sudo[89251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d 1073741824
Sep 09 03:50:16 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:17 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d 1073741824" returned: 0 in 0.873s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:17 devstack sudo[89259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d
Sep 09 03:50:17 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:17 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d" returned: 0 in 0.262s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:50:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782f93f1-3246-469a-9e51-71fdb7eb53ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0415756d-0dbe-4c5f-bf42-347ad4da5df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:17 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Volume volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d (b8975fd5-2649-4e21-bf68-ee6fe0e0a29d): created successfully
Sep 09 03:50:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0415756d-0dbe-4c5f-bf42-347ad4da5df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Flow 'volume_create_manager' (36627cb6-db96-412e-9407-f1d02bf24839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:50:17 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c9e72d91-c156-4425-b7a7-88a6ad89784c tempest-AttachVolumeNegativeTest-1819164189 None] Created volume successfully.
Sep 09 03:50:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-293f84ca-034e-4da0-a0f4-4903fcfc8d28 req-6e198cf2-3c90-4781-b053-1e823fec7da0 tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-293f84ca-034e-4da0-a0f4-4903fcfc8d28 req-6e198cf2-3c90-4781-b053-1e823fec7da0 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-293f84ca-034e-4da0-a0f4-4903fcfc8d28 req-6e198cf2-3c90-4781-b053-1e823fec7da0 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-293f84ca-034e-4da0-a0f4-4903fcfc8d28 req-6e198cf2-3c90-4781-b053-1e823fec7da0 tempest-AttachVolumeNegativeTest-1819164189 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf7b9bb2-f905-44ed-88f5-2095079efba7', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 03:50:20 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-293f84ca-034e-4da0-a0f4-4903fcfc8d28 req-6e198cf2-3c90-4781-b053-1e823fec7da0 tempest-AttachVolumeNegativeTest-1819164189 None] attachment_update completed successfully.
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Flow 'volume_create_manager' (018c4649-a171-4187-8c9b-502fadf30360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321af535-d44c-4188-a013-3740a9b0a740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321af535-d44c-4188-a013-3740a9b0a740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-126792855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c0ffd9d2d454d70b72d67b1c42897ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:25Z,use_quota=True,user_id='1fabe028874e44219b7a6db9380e4c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a238dc61-78da-4f8f-a5a5-323d2fb8d154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a238dc61-78da-4f8f-a5a5-323d2fb8d154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10d4f83-30bc-4c05-98bc-6c867abb5be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10d4f83-30bc-4c05-98bc-6c867abb5be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a', 'volume_name': 'volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f227971-be8b-480f-afe2-cfbdee652af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f227971-be8b-480f-afe2-cfbdee652af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315c3884-499c-499d-abdf-91c5b0930556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:24 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Volume 2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a', 'volume_size': 1}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-126792855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c0ffd9d2d454d70b72d67b1c42897ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:25Z,use_quota=True,user_id='1fabe028874e44219b7a6db9380e4c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Creating volume 2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:50:24 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:50:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:24 devstack sudo[89695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a 1073741824
Sep 09 03:50:24 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:25 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a 1073741824" returned: 0 in 0.463s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:25 devstack sudo[89701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a
Sep 09 03:50:25 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:25 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a" returned: 0 in 0.300s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:50:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315c3884-499c-499d-abdf-91c5b0930556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf81c198-a86a-4b65-8806-2b51e3bdbe5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:25 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Volume volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a (2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a): created successfully
Sep 09 03:50:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf81c198-a86a-4b65-8806-2b51e3bdbe5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Flow 'volume_create_manager' (018c4649-a171-4187-8c9b-502fadf30360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:50:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-2aeba2c4-88b4-4ad4-8a59-c5268db043b0 req-54047ec4-b2a9-4eb4-a62f-9210fb93eb6b tempest-VolumesSnapshotsTestJSON-716899321 None] Created volume successfully.
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] Creating offline snapshot fe111f37-b242-4bec-bc48-23fc47affdf6 of volume 2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6d05b4-803d-404a-9eea-6953c13d1f72]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:26 devstack sudo[89709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a
Sep 09 03:50:26 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:26 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a" returned: 0 in 0.461s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:26 devstack sudo[89716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6 1G
Sep 09 03:50:26 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:26 devstack sudo[89718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:50:26 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:27 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.319s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:50:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:50:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 8 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 03:50:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 03:50:27 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6 1G" returned: 0 in 0.618s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:27 devstack sudo[89726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6
Sep 09 03:50:27 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:27 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6" returned: 0 in 0.441s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:27 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6 is being set with open permissions: ugo+rw
Sep 09 03:50:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:27 devstack sudo[89736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6
Sep 09 03:50:27 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:28 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6" returned: 0 in 0.290s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:28 devstack sudo[89748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.info
Sep 09 03:50:28 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:28 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.info" returned: 0 in 0.320s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:28 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.info is being set with open permissions: ugo+rw
Sep 09 03:50:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:28 devstack sudo[89754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.info
Sep 09 03:50:28 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:28 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.info" returned: 0 in 0.285s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.526s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:28 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-2933381a-1961-4fbd-b2af-56e4fcacf1e2 req-a4613091-c91e-40a7-a012-a0035903a4f5 tempest-VolumesSnapshotsTestJSON-716899321 None] Create snapshot completed successfully
Sep 09 03:50:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Acquiring lock "cinder-fe111f37-b242-4bec-bc48-23fc47affdf6-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:50:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "cinder-fe111f37-b242-4bec-bc48-23fc47affdf6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:50:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Acquiring lock "cinder-quobyte-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:50:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "cinder-quobyte-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:50:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Acquiring lock "cinder-quobyte-fe111f37-b242-4bec-bc48-23fc47affdf6" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:50:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "cinder-quobyte-fe111f37-b242-4bec-bc48-23fc47affdf6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:50:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Deleting offline snapshot fe111f37-b242-4bec-bc48-23fc47affdf6 of volume 2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:50:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] snapshot_file for this snap is: volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:50:30 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54b2e8f-dc24-4762-992a-3c347cec2b16]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:50:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:30 devstack sudo[89759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6
Sep 09 03:50:30 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:30 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6" returned: 0 in 0.579s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:50:30 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dab67c-7cbc-4b3f-b61d-fcc4ec357db7]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:50:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:30 devstack sudo[89764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a
Sep 09 03:50:30 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:31 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a" returned: 0 in 0.551s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:31 devstack sudo[89769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6
Sep 09 03:50:31 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:31 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6" returned: 0 in 0.604s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:32 devstack sudo[89785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6
Sep 09 03:50:32 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:32 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a.fe111f37-b242-4bec-bc48-23fc47affdf6" returned: 0 in 0.477s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "cinder-quobyte-fe111f37-b242-4bec-bc48-23fc47affdf6" released by "_delete_snapshot" :: held 2.387s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:50:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "cinder-quobyte-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a" released by "delete_snapshot" :: held 2.425s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:50:32 devstack cinder-volume[87558]: WARNING cinder.quota [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:50:32 devstack cinder-volume[87558]: DEBUG cinder.quota [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Created reservations ['dc261738-abba-4efb-835c-e27575ef9b66', 'd1273cf0-f883-4487-b0ae-3207aa70feda', '2800de4b-07ad-4481-bf27-74f3159e0e57', '732e73f8-acf5-493a-857b-34431a4d943c'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:50:32 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Delete snapshot completed successfully.
Sep 09 03:50:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-db54c958-8a84-41f7-94d3-9a475fffe9d6 req-2975e719-1f98-4763-ab1b-d51e848a8f4b tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "cinder-fe111f37-b242-4bec-bc48-23fc47affdf6-delete_snapshot" released by "delete_snapshot" :: held 2.628s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:50:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Acquiring lock "cinder-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:50:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "cinder-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:50:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Acquiring lock "cinder-quobyte-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:50:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "cinder-quobyte-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a" acquired by "delete_volume" :: waited 0.028s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:50:33 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d5f414-e641-4fad-8b1f-210e8a1bf368]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:50:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:34 devstack sudo[89825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a
Sep 09 03:50:34 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:34 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a" returned: 0 in 0.763s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:34 devstack sudo[89832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a
Sep 09 03:50:34 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:34 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a" returned: 0 in 0.302s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "cinder-quobyte-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a" released by "delete_volume" :: held 1.191s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:50:34 devstack cinder-volume[87558]: DEBUG cinder.quota [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Created reservations ['f58f45dd-51e6-464f-b40f-ea0dafc6a1f7', 'f45381ae-f03e-40c1-abcc-ab14afdad57e', 'f108a4f9-272f-4408-ad09-3649e401d2a3', 'b255a18c-08eb-495b-a67f-658ef98bb672'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:50:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:50:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:50:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:35 devstack sudo[89838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:50:35 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:35 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.757s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:35 devstack cinder-volume[87558]: DEBUG cinder.manager [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:50:35 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Deleted volume successfully.
Sep 09 03:50:36 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-84573d2d-4939-4a50-a677-6fab29bf9e8b req-29b5c413-5a66-4d58-aa68-a5dc7c5d05fe tempest-VolumesSnapshotsTestJSON-716899321 None] Lock "cinder-2750cfc3-4ce0-4dc2-a27e-b89cbef0b32a-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=41,cinder:UPDATE=43,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=33,cinder:SELECT=43,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-82c8e5d4-0e08-4c72-8c0c-dba36b02df95 req-dd71e0e2-f08c-418b-aef2-81da40a985e7 tempest-TaggedAttachmentsTest-121214804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-82c8e5d4-0e08-4c72-8c0c-dba36b02df95 req-dd71e0e2-f08c-418b-aef2-81da40a985e7 tempest-TaggedAttachmentsTest-121214804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-82c8e5d4-0e08-4c72-8c0c-dba36b02df95 req-dd71e0e2-f08c-418b-aef2-81da40a985e7 tempest-TaggedAttachmentsTest-121214804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.094s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Flow 'volume_create_manager' (4840697b-e471-462e-9818-d5e5afdddc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7169f1d-c145-4742-bf04-311ddd893462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-82c8e5d4-0e08-4c72-8c0c-dba36b02df95 req-dd71e0e2-f08c-418b-aef2-81da40a985e7 tempest-TaggedAttachmentsTest-121214804 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-bea05a71-536d-49e1-92db-07ba058c8f1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72e97e8a-e09f-4fad-bc43-89207a84a644', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7169f1d-c145-4742-bf04-311ddd893462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-626537361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a535e2a9-3722-416f-a04c-0b6011d263be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58d6b0196f164f21bd19b699b9bd5f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:44Z,use_quota=True,user_id='929a4421163b45a6a4227a5223f505bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5521df-cc99-4204-9ab0-41d9f1e29186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5521df-cc99-4204-9ab0-41d9f1e29186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1492d9-cfa9-4179-aed9-549965751d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1492d9-cfa9-4179-aed9-549965751d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a535e2a9-3722-416f-a04c-0b6011d263be', 'volume_name': 'volume-a535e2a9-3722-416f-a04c-0b6011d263be', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d3a424-ef70-4602-a819-358b4c16b2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d3a424-ef70-4602-a819-358b4c16b2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e605f6-4c57-40c3-ae7d-e73b1d82bf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:44 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Volume a535e2a9-3722-416f-a04c-0b6011d263be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a535e2a9-3722-416f-a04c-0b6011d263be', 'volume_size': 1}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-626537361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a535e2a9-3722-416f-a04c-0b6011d263be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58d6b0196f164f21bd19b699b9bd5f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:44Z,use_quota=True,user_id='929a4421163b45a6a4227a5223f505bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Creating volume a535e2a9-3722-416f-a04c-0b6011d263be {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:50:44 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:50:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a535e2a9-3722-416f-a04c-0b6011d263be 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:44 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a535e2a9-3722-416f-a04c-0b6011d263be 1073741824
Sep 09 03:50:44 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:44 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-82c8e5d4-0e08-4c72-8c0c-dba36b02df95 req-dd71e0e2-f08c-418b-aef2-81da40a985e7 tempest-TaggedAttachmentsTest-121214804 None] attachment_update completed successfully.
Sep 09 03:50:45 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a535e2a9-3722-416f-a04c-0b6011d263be 1073741824" returned: 0 in 0.598s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a535e2a9-3722-416f-a04c-0b6011d263be {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:45 devstack sudo[89948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a535e2a9-3722-416f-a04c-0b6011d263be
Sep 09 03:50:45 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:45 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a535e2a9-3722-416f-a04c-0b6011d263be" returned: 0 in 0.448s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:50:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e605f6-4c57-40c3-ae7d-e73b1d82bf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a535e2a9-3722-416f-a04c-0b6011d263be', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc444e82-88dc-4138-bd4f-6fd929d40ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:45 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Volume volume-a535e2a9-3722-416f-a04c-0b6011d263be (a535e2a9-3722-416f-a04c-0b6011d263be): created successfully
Sep 09 03:50:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc444e82-88dc-4138-bd4f-6fd929d40ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Flow 'volume_create_manager' (4840697b-e471-462e-9818-d5e5afdddc98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:50:45 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f1b83fb5-c726-4419-8772-238717cc3e32 tempest-VolumesTestJSON-1948106846 None] Created volume successfully.
Sep 09 03:50:47 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:50:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Flow 'volume_create_manager' (5d3b3e3b-5475-487e-be24-c8a2a28557aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:50:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0e86fc-b394-42bd-a675-5951d92cbb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0e86fc-b394-42bd-a675-5951d92cbb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1015652628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d768b42-dd57-44f1-a2b5-1eee8d121b83,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58d6b0196f164f21bd19b699b9bd5f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:48Z,use_quota=True,user_id='929a4421163b45a6a4227a5223f505bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ea20d7-53f2-4894-ae39-aa7af534d0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ea20d7-53f2-4894-ae39-aa7af534d0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de574de-bd03-4486-8f9c-47416d7da659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de574de-bd03-4486-8f9c-47416d7da659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d768b42-dd57-44f1-a2b5-1eee8d121b83', 'volume_name': 'volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4faf1c-6113-4cdf-aecf-3c0f28258a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4faf1c-6113-4cdf-aecf-3c0f28258a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf34890-075c-4a91-a034-206258a2c60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:48 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Volume 0d768b42-dd57-44f1-a2b5-1eee8d121b83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83', 'volume_size': 1}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1015652628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d768b42-dd57-44f1-a2b5-1eee8d121b83,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58d6b0196f164f21bd19b699b9bd5f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:48Z,use_quota=True,user_id='929a4421163b45a6a4227a5223f505bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Creating volume 0d768b42-dd57-44f1-a2b5-1eee8d121b83 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:50:48 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:48 devstack sudo[90011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83 1073741824
Sep 09 03:50:48 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:48 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-bfba740e-aa07-4868-9946-22e3e0879b2c req-b3499039-3b43-413b-8bc9-36cc90f6f12a tempest-TaggedAttachmentsTest-121214804 None] Terminate volume connection completed successfully.
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-bfba740e-aa07-4868-9946-22e3e0879b2c req-b3499039-3b43-413b-8bc9-36cc90f6f12a tempest-TaggedAttachmentsTest-121214804 None] Deleting attachment 72e97e8a-e09f-4fad-bc43-89207a84a644. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 03:50:48 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83 1073741824" returned: 0 in 0.650s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:48 devstack sudo[90018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83
Sep 09 03:50:48 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:49 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83" returned: 0 in 0.507s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:50:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf34890-075c-4a91-a034-206258a2c60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57623d62-f5ac-4154-95d4-bf2794bfdec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:49 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Volume volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83 (0d768b42-dd57-44f1-a2b5-1eee8d121b83): created successfully
Sep 09 03:50:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57623d62-f5ac-4154-95d4-bf2794bfdec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Flow 'volume_create_manager' (5d3b3e3b-5475-487e-be24-c8a2a28557aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:50:49 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-28485e57-09b2-4803-a8ae-6058899fea98 tempest-VolumesTestJSON-1948106846 None] Created volume successfully.
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Flow 'volume_create_manager' (aa355a66-ad37-462a-82f0-9931d29c8f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10342a04-9fcf-45b6-a788-d55a3a6f7be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10342a04-9fcf-45b6-a788-d55a3a6f7be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1698145394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c65da359-9ebd-49a6-a274-9305f13d8704,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58d6b0196f164f21bd19b699b9bd5f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:51Z,use_quota=True,user_id='929a4421163b45a6a4227a5223f505bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37015de5-53a1-4974-8544-d8ecee33722a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37015de5-53a1-4974-8544-d8ecee33722a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ee0788-151f-4386-8c13-d66bfcc9c01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ee0788-151f-4386-8c13-d66bfcc9c01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c65da359-9ebd-49a6-a274-9305f13d8704', 'volume_name': 'volume-c65da359-9ebd-49a6-a274-9305f13d8704', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4bc2ae7-5265-4a8b-b8f4-c75989171eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4bc2ae7-5265-4a8b-b8f4-c75989171eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82738e3-dff8-439c-be5a-cfdbecdc4da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:50 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Volume c65da359-9ebd-49a6-a274-9305f13d8704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c65da359-9ebd-49a6-a274-9305f13d8704', 'volume_size': 1}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1698145394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c65da359-9ebd-49a6-a274-9305f13d8704,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58d6b0196f164f21bd19b699b9bd5f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:51Z,use_quota=True,user_id='929a4421163b45a6a4227a5223f505bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Creating volume c65da359-9ebd-49a6-a274-9305f13d8704 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:50:50 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:50:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c65da359-9ebd-49a6-a274-9305f13d8704 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:50 devstack sudo[90041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c65da359-9ebd-49a6-a274-9305f13d8704 1073741824
Sep 09 03:50:50 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:51 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c65da359-9ebd-49a6-a274-9305f13d8704 1073741824" returned: 0 in 0.574s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c65da359-9ebd-49a6-a274-9305f13d8704 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:51 devstack sudo[90048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c65da359-9ebd-49a6-a274-9305f13d8704
Sep 09 03:50:51 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:51 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c65da359-9ebd-49a6-a274-9305f13d8704" returned: 0 in 0.354s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:50:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82738e3-dff8-439c-be5a-cfdbecdc4da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c65da359-9ebd-49a6-a274-9305f13d8704', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b563cdbc-98a4-4827-aeb8-4ed9d44241b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:50:51 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Volume volume-c65da359-9ebd-49a6-a274-9305f13d8704 (c65da359-9ebd-49a6-a274-9305f13d8704): created successfully
Sep 09 03:50:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b563cdbc-98a4-4827-aeb8-4ed9d44241b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:50:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Flow 'volume_create_manager' (aa355a66-ad37-462a-82f0-9931d29c8f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:50:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-142758c7-7ec8-4320-92ab-79f300d1e118 tempest-VolumesTestJSON-1948106846 None] Created volume successfully.
Sep 09 03:50:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Acquiring lock "cinder-c65da359-9ebd-49a6-a274-9305f13d8704-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:50:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Lock "cinder-c65da359-9ebd-49a6-a274-9305f13d8704-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:50:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Acquiring lock "cinder-quobyte-c65da359-9ebd-49a6-a274-9305f13d8704" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:50:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Lock "cinder-quobyte-c65da359-9ebd-49a6-a274-9305f13d8704" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:50:54 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1507ebc3-fc03-47d8-8b9a-97561b56e47e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:50:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c65da359-9ebd-49a6-a274-9305f13d8704 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:54 devstack sudo[90092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c65da359-9ebd-49a6-a274-9305f13d8704
Sep 09 03:50:54 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:55 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c65da359-9ebd-49a6-a274-9305f13d8704" returned: 0 in 0.615s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c65da359-9ebd-49a6-a274-9305f13d8704 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:55 devstack sudo[90126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c65da359-9ebd-49a6-a274-9305f13d8704
Sep 09 03:50:55 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:55 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c65da359-9ebd-49a6-a274-9305f13d8704" returned: 0 in 0.297s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Lock "cinder-quobyte-c65da359-9ebd-49a6-a274-9305f13d8704" released by "delete_volume" :: held 0.969s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:50:55 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Created reservations ['9e617ba2-6a83-4363-b76d-f714490cd3b1', '401aa6c1-5f22-41c4-bc56-ed99fd3dc866', '875418a3-965c-4696-b222-45325c38c634', 'bdda67a3-e451-400d-b6b3-1ef5e2b6e424'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:50:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:50:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:50:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:55 devstack sudo[90131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:50:55 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:56 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.266s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:56 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:50:56 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Deleted volume successfully.
Sep 09 03:50:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-70aea677-88c8-4c8b-be0e-82b93a02668d tempest-VolumesTestJSON-1948106846 None] Lock "cinder-c65da359-9ebd-49a6-a274-9305f13d8704-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:50:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Acquiring lock "cinder-0d768b42-dd57-44f1-a2b5-1eee8d121b83-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:50:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Lock "cinder-0d768b42-dd57-44f1-a2b5-1eee8d121b83-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:50:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Acquiring lock "cinder-quobyte-0d768b42-dd57-44f1-a2b5-1eee8d121b83" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:50:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Lock "cinder-quobyte-0d768b42-dd57-44f1-a2b5-1eee8d121b83" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:50:56 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30bbc6a-bc36-46f1-985f-c42115596433]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:50:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:57 devstack sudo[90135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83
Sep 09 03:50:57 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:57 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83" returned: 0 in 0.417s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:57 devstack sudo[90141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83
Sep 09 03:50:57 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:57 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0d768b42-dd57-44f1-a2b5-1eee8d121b83" returned: 0 in 0.285s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Lock "cinder-quobyte-0d768b42-dd57-44f1-a2b5-1eee8d121b83" released by "delete_volume" :: held 0.743s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:50:57 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Created reservations ['5e2e2ca3-936f-442c-8b10-b23f0545d45a', '1000c731-4d23-4983-8f50-ec84e9269f82', 'ef736e4e-3676-4a33-99ab-e618633b834d', '200ca057-e0b8-404e-a321-647d0eb989a6'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:50:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:50:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:50:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:57 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:50:57 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Acquiring lock "cinder-a535e2a9-3722-416f-a04c-0b6011d263be-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:50:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Lock "cinder-a535e2a9-3722-416f-a04c-0b6011d263be-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:50:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Acquiring lock "cinder-quobyte-a535e2a9-3722-416f-a04c-0b6011d263be" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:50:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Lock "cinder-quobyte-a535e2a9-3722-416f-a04c-0b6011d263be" acquired by "delete_volume" :: waited 0.022s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:50:58 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d07b698-c2cd-4493-973e-607df4945fe4]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:50:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a535e2a9-3722-416f-a04c-0b6011d263be {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:58 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.505s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:58 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:50:58 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Deleted volume successfully.
Sep 09 03:50:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-614cd50e-630c-4147-9c1f-585c278b91f9 tempest-VolumesTestJSON-1948106846 None] Lock "cinder-0d768b42-dd57-44f1-a2b5-1eee8d121b83-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:50:58 devstack sudo[90148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a535e2a9-3722-416f-a04c-0b6011d263be
Sep 09 03:50:58 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:58 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a535e2a9-3722-416f-a04c-0b6011d263be" returned: 0 in 0.420s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a535e2a9-3722-416f-a04c-0b6011d263be {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:58 devstack sudo[90154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a535e2a9-3722-416f-a04c-0b6011d263be
Sep 09 03:50:58 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:59 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a535e2a9-3722-416f-a04c-0b6011d263be" returned: 0 in 0.272s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Lock "cinder-quobyte-a535e2a9-3722-416f-a04c-0b6011d263be" released by "delete_volume" :: held 0.741s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:50:59 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Created reservations ['685bf031-db04-49de-b330-da000f88493f', '845d6b3e-8377-4960-b9d1-9cf427fb7beb', '8fb60338-012a-4209-9052-7fd3160cf67a', '494aa055-adef-449e-b3da-b476a27c47a5'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:50:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:50:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:50:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:50:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:50:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:50:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:50:59 devstack sudo[90157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:50:59 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:50:59 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root
Sep 09 03:50:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.339s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:50:59 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:50:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Deleted volume successfully.
Sep 09 03:50:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e8a1697f-49b8-48d4-a15b-a26fb6176aeb tempest-VolumesTestJSON-1948106846 None] Lock "cinder-a535e2a9-3722-416f-a04c-0b6011d263be-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:51:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Acquiring lock "cinder-bea05a71-536d-49e1-92db-07ba058c8f1d-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:51:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Lock "cinder-bea05a71-536d-49e1-92db-07ba058c8f1d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:51:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Acquiring lock "cinder-quobyte-bea05a71-536d-49e1-92db-07ba058c8f1d" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:51:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Lock "cinder-quobyte-bea05a71-536d-49e1-92db-07ba058c8f1d" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:51:01 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4c4865-e5ff-440e-8059-b9cb8ba55476]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:51:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bea05a71-536d-49e1-92db-07ba058c8f1d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:51:01 devstack sudo[90189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bea05a71-536d-49e1-92db-07ba058c8f1d
Sep 09 03:51:01 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:51:02 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root
Sep 09 03:51:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bea05a71-536d-49e1-92db-07ba058c8f1d" returned: 0 in 0.522s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:51:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bea05a71-536d-49e1-92db-07ba058c8f1d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:51:02 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bea05a71-536d-49e1-92db-07ba058c8f1d
Sep 09 03:51:02 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:51:02 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Sep 09 03:51:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bea05a71-536d-49e1-92db-07ba058c8f1d" returned: 0 in 0.348s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:51:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Lock "cinder-quobyte-bea05a71-536d-49e1-92db-07ba058c8f1d" released by "delete_volume" :: held 0.922s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:51:02 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Created reservations ['bd98ddb0-e878-4a95-96d9-00ebb9c6f42e', '05dfd1f9-93fc-4676-affe-ddb5ba5ed235', '4d671fb7-6689-40d7-9e9b-b89de3dadfd0', 'fd2a7274-f967-4f7a-b1df-05dbf88efb6b'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:51:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:51:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:51:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:51:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:51:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:51:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:51:02 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:51:02 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:51:03 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Sep 09 03:51:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.295s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:51:03 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:51:03 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Deleted volume successfully.
Sep 09 03:51:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3953b31f-8385-4d7c-ad19-e0e8f8c929db tempest-TaggedAttachmentsTest-121214804 None] Lock "cinder-bea05a71-536d-49e1-92db-07ba058c8f1d-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:51:10 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-8b9a3bf4-565b-4208-8326-f871ec631958 req-fd75bd3f-d0da-4ad7-a61d-ef0b75139120 tempest-AttachVolumeNegativeTest-1819164189 None] Terminate volume connection completed successfully.
Sep 09 03:51:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-8b9a3bf4-565b-4208-8326-f871ec631958 req-fd75bd3f-d0da-4ad7-a61d-ef0b75139120 tempest-AttachVolumeNegativeTest-1819164189 None] Deleting attachment bf7b9bb2-f905-44ed-88f5-2095079efba7. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 03:51:13 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=37,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:51:20 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=31,cinder:UPDATE=39,cinder:DELETE=2,cinder:INSERT=9 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Flow 'volume_create_manager' (5882631b-12a3-41df-aad4-401d67ce6986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a790d1e-da3e-4394-ba8e-0875fa5dfcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a790d1e-da3e-4394-ba8e-0875fa5dfcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-905298845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4dc1dc-77d7-42de-8760-58612e398a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94569c50bbc4741ad97651b22f35beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:21Z,use_quota=True,user_id='732e2748d5e14196ba882d5793a90f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8a427b-84a2-47f1-b267-ccc96f852b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8a427b-84a2-47f1-b267-ccc96f852b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9483d0-303b-4797-8f74-4ad65d62c5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9483d0-303b-4797-8f74-4ad65d62c5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4dc1dc-77d7-42de-8760-58612e398a3d', 'volume_name': 'volume-de4dc1dc-77d7-42de-8760-58612e398a3d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b720367a-93f3-4d24-9e42-f3e2b89fcf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b720367a-93f3-4d24-9e42-f3e2b89fcf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5d1245-70b3-4357-a673-9dcea09d4220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:51:21 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Volume de4dc1dc-77d7-42de-8760-58612e398a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4dc1dc-77d7-42de-8760-58612e398a3d', 'volume_size': 1}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-905298845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4dc1dc-77d7-42de-8760-58612e398a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94569c50bbc4741ad97651b22f35beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:21Z,use_quota=True,user_id='732e2748d5e14196ba882d5793a90f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Creating volume de4dc1dc-77d7-42de-8760-58612e398a3d {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:51:21 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:51:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4dc1dc-77d7-42de-8760-58612e398a3d 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:51:21 devstack sudo[90339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4dc1dc-77d7-42de-8760-58612e398a3d 1073741824
Sep 09 03:51:21 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:51:22 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root
Sep 09 03:51:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4dc1dc-77d7-42de-8760-58612e398a3d 1073741824" returned: 0 in 0.718s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:51:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4dc1dc-77d7-42de-8760-58612e398a3d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:51:22 devstack sudo[90350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4dc1dc-77d7-42de-8760-58612e398a3d
Sep 09 03:51:22 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:51:22 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root
Sep 09 03:51:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4dc1dc-77d7-42de-8760-58612e398a3d" returned: 0 in 0.334s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:51:22 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:51:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:51:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5d1245-70b3-4357-a673-9dcea09d4220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4dc1dc-77d7-42de-8760-58612e398a3d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:51:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3aa891-5129-4555-a2cb-a7b4e2b81b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:51:22 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Volume volume-de4dc1dc-77d7-42de-8760-58612e398a3d (de4dc1dc-77d7-42de-8760-58612e398a3d): created successfully
Sep 09 03:51:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3aa891-5129-4555-a2cb-a7b4e2b81b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:51:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Flow 'volume_create_manager' (5882631b-12a3-41df-aad4-401d67ce6986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:51:22 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f5d16c6f-d73a-4dc0-a199-e77fa3f2e041 tempest-VolumesAdminNegativeTest-163796544 None] Created volume successfully.
Sep 09 03:51:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Acquiring lock "cinder-de4dc1dc-77d7-42de-8760-58612e398a3d-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:51:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Lock "cinder-de4dc1dc-77d7-42de-8760-58612e398a3d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:51:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Acquiring lock "cinder-quobyte-de4dc1dc-77d7-42de-8760-58612e398a3d" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:51:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Lock "cinder-quobyte-de4dc1dc-77d7-42de-8760-58612e398a3d" acquired by "delete_volume" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:51:24 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c46ee0-a7e8-4f11-9356-4c0941eb5252]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:51:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4dc1dc-77d7-42de-8760-58612e398a3d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:51:24 devstack sudo[90354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4dc1dc-77d7-42de-8760-58612e398a3d
Sep 09 03:51:24 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:51:24 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root
Sep 09 03:51:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4dc1dc-77d7-42de-8760-58612e398a3d" returned: 0 in 0.545s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:51:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4dc1dc-77d7-42de-8760-58612e398a3d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:51:24 devstack sudo[90362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4dc1dc-77d7-42de-8760-58612e398a3d
Sep 09 03:51:24 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:51:25 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root
Sep 09 03:51:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4dc1dc-77d7-42de-8760-58612e398a3d" returned: 0 in 0.501s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:51:25 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Lock "cinder-quobyte-de4dc1dc-77d7-42de-8760-58612e398a3d" released by "delete_volume" :: held 1.095s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:51:25 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Created reservations ['bd7b3ba8-5459-4fe5-b87f-8a64812d7263', 'be868f0b-d311-4578-af66-70b34ce18ab0', '9b938fca-8b9d-4b9b-bdc7-7e937fc44866', 'ef968281-ab74-4ab9-9d3b-b3bd6fad1ea5'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:51:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:51:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:51:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:51:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:51:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:51:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:51:25 devstack sudo[90368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:51:25 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:51:26 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root
Sep 09 03:51:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.489s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:51:26 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:51:26 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Deleted volume successfully.
Sep 09 03:51:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7fed99b3-47c5-40c8-9871-3d3b382b5bd0 tempest-VolumesAdminNegativeTest-163796544 None] Lock "cinder-de4dc1dc-77d7-42de-8760-58612e398a3d-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:51:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:51:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:51:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:51:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:51:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:51:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:51:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:51:27 devstack sudo[90376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:51:27 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:51:27 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root
Sep 09 03:51:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.597s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:51:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:51:35 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:51:36 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Flow 'volume_create_manager' (f8804e81-e983-4938-a0b7-90e7207d3fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becc0b24-b1b9-4a73-9f6e-c354cf5616db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becc0b24-b1b9-4a73-9f6e-c354cf5616db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1486253958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b80513f-7a8c-4cb3-b5bf-e38bcbeef124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e71c2f0a29c4725b1bf9655ae5e6ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:02Z,use_quota=True,user_id='9a1c597025c14d93a4d3acb59563f57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(459d3d40-015f-4841-be3c-1b4ee61364a5),volume_type_id=459d3d40-015f-4841-be3c-1b4ee61364a5)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcf2475-6ad4-4cb5-a63c-5e4153e2a7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcf2475-6ad4-4cb5-a63c-5e4153e2a7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ccb52e-2131-4350-94d1-cab85e02a890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ccb52e-2131-4350-94d1-cab85e02a890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b80513f-7a8c-4cb3-b5bf-e38bcbeef124', 'volume_name': 'volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d95223f-66af-491c-91f5-6b009979c868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d95223f-66af-491c-91f5-6b009979c868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625c71d3-8870-443e-8211-d50b93aac340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:01 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Volume 6b80513f-7a8c-4cb3-b5bf-e38bcbeef124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124', 'volume_size': 1}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1486253958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b80513f-7a8c-4cb3-b5bf-e38bcbeef124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e71c2f0a29c4725b1bf9655ae5e6ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:02Z,use_quota=True,user_id='9a1c597025c14d93a4d3acb59563f57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(459d3d40-015f-4841-be3c-1b4ee61364a5),volume_type_id=459d3d40-015f-4841-be3c-1b4ee61364a5)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Creating volume 6b80513f-7a8c-4cb3-b5bf-e38bcbeef124 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:52:01 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:52:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:01 devstack sudo[90683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124 1073741824
Sep 09 03:52:01 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:02 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124 1073741824" returned: 0 in 0.518s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:02 devstack sudo[90691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124
Sep 09 03:52:02 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:02 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124" returned: 0 in 0.339s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:52:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:02 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625c71d3-8870-443e-8211-d50b93aac340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:02 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e458e93-4f7e-4c40-9187-254d33086cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:02 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Volume volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124 (6b80513f-7a8c-4cb3-b5bf-e38bcbeef124): created successfully
Sep 09 03:52:02 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e458e93-4f7e-4c40-9187-254d33086cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:02 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Flow 'volume_create_manager' (f8804e81-e983-4938-a0b7-90e7207d3fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:02 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0f5cfcd8-8021-42c2-95a9-9cf6a70226bc tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Created volume successfully.
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Flow 'volume_create_manager' (075437ce-b22c-46e3-982b-3aee60b40b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa9920e-f517-4baa-b83a-a33e35d7af62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa9920e-f517-4baa-b83a-a33e35d7af62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1835626411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfe516d-ee19-47c0-817d-7b06a7d3dbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1221a30670e54bbcb80698a594e6c130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:03Z,use_quota=True,user_id='df0acdad6628427eabac22bceef94f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7005fe8-9958-4a7b-946b-90ebbc6d2a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7005fe8-9958-4a7b-946b-90ebbc6d2a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57ac3d9-6392-4c58-a9ce-adb3e3cc5cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57ac3d9-6392-4c58-a9ce-adb3e3cc5cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdfe516d-ee19-47c0-817d-7b06a7d3dbf6', 'volume_name': 'volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ba86e8-e542-4181-a5e5-1a63833a9b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ba86e8-e542-4181-a5e5-1a63833a9b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06f3a25-2fbf-41b5-9664-394e9df1f3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:03 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Volume cdfe516d-ee19-47c0-817d-7b06a7d3dbf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6', 'volume_size': 1}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1835626411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfe516d-ee19-47c0-817d-7b06a7d3dbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1221a30670e54bbcb80698a594e6c130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:03Z,use_quota=True,user_id='df0acdad6628427eabac22bceef94f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Creating volume cdfe516d-ee19-47c0-817d-7b06a7d3dbf6 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:52:03 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:03 devstack sudo[90694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6 1073741824
Sep 09 03:52:03 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:03 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3691b2d7-0eef-4829-ac38-b9afd30d93ff tempest-GroupSnapshotsTest-2146613640 None] Group tempest-GroupSnapshotsTest-Group-1312729882: creating
Sep 09 03:52:03 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3691b2d7-0eef-4829-ac38-b9afd30d93ff tempest-GroupSnapshotsTest-2146613640 None] Group tempest-GroupSnapshotsTest-Group-1312729882: created successfully
Sep 09 03:52:03 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3691b2d7-0eef-4829-ac38-b9afd30d93ff tempest-GroupSnapshotsTest-2146613640 None] Create group completed successfully.
Sep 09 03:52:03 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6 1073741824" returned: 0 in 0.444s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:03 devstack sudo[90700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6
Sep 09 03:52:03 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:03 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6" returned: 0 in 0.256s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:52:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06f3a25-2fbf-41b5-9664-394e9df1f3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a68798-40e2-4dbb-afd0-7323812e5eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:04 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Volume volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6 (cdfe516d-ee19-47c0-817d-7b06a7d3dbf6): created successfully
Sep 09 03:52:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a68798-40e2-4dbb-afd0-7323812e5eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Flow 'volume_create_manager' (075437ce-b22c-46e3-982b-3aee60b40b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:04 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-87eb34a2-7dd6-4777-9cab-356a026f8272 tempest-AttachVolumeNegativeTest-1819164189 None] Created volume successfully.
Sep 09 03:52:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d817cf8-af97-4db9-afee-cc77aab00e09 tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d817cf8-af97-4db9-afee-cc77aab00e09 tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d817cf8-af97-4db9-afee-cc77aab00e09 tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d817cf8-af97-4db9-afee-cc77aab00e09 tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d817cf8-af97-4db9-afee-cc77aab00e09 tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d817cf8-af97-4db9-afee-cc77aab00e09 tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:04 devstack sudo[90703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:52:04 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:04 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d817cf8-af97-4db9-afee-cc77aab00e09 tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.246s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:04 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-4d817cf8-af97-4db9-afee-cc77aab00e09 tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:52:04 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4d817cf8-af97-4db9-afee-cc77aab00e09 tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Retype volume completed successfully.
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Flow 'volume_create_manager' (2729efe0-2db6-470e-8bb9-db3810e08458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb5a5df-6be6-4fa2-994f-7ffdad36d56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb5a5df-6be6-4fa2-994f-7ffdad36d56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-436906147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9824c4c4-e7c7-4101-97ec-e1e324b83840,host='devstack@QuobyteHD#QuobyteHD',id=3d121f9a-1fe5-412e-acb2-f6967780a8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cbd3b7885e4cfd8139d19e6a5b578e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:05Z,use_quota=True,user_id='9893879908944d4f82bb7619627bdc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9a4985-d8ff-4fa7-a90f-9f0bef05c30a),volume_type_id=ad9a4985-d8ff-4fa7-a90f-9f0bef05c30a)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe661ec-b83f-40cf-8002-9a9dd9d03694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe661ec-b83f-40cf-8002-9a9dd9d03694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2511c7ce-f3ac-487e-bced-3c2b0cf12c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2511c7ce-f3ac-487e-bced-3c2b0cf12c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d121f9a-1fe5-412e-acb2-f6967780a8de', 'volume_name': 'volume-3d121f9a-1fe5-412e-acb2-f6967780a8de', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9691bb89-3b05-4458-b40a-7aa1fe780428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9691bb89-3b05-4458-b40a-7aa1fe780428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f32f12d-9b39-4e46-8960-5cb3a526cfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:05 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Volume 3d121f9a-1fe5-412e-acb2-f6967780a8de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d121f9a-1fe5-412e-acb2-f6967780a8de', 'volume_size': 1}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9824c4c4-e7c7-4101-97ec-e1e324b83840,created_at=2026-09-09T01:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-436906147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9824c4c4-e7c7-4101-97ec-e1e324b83840,host='devstack@QuobyteHD#QuobyteHD',id=3d121f9a-1fe5-412e-acb2-f6967780a8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cbd3b7885e4cfd8139d19e6a5b578e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:05Z,use_quota=True,user_id='9893879908944d4f82bb7619627bdc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9a4985-d8ff-4fa7-a90f-9f0bef05c30a),volume_type_id=ad9a4985-d8ff-4fa7-a90f-9f0bef05c30a)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Creating volume 3d121f9a-1fe5-412e-acb2-f6967780a8de {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:52:05 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:05 devstack sudo[90730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de 1073741824
Sep 09 03:52:05 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Acquiring lock "cinder-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Lock "cinder-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Acquiring lock "cinder-quobyte-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Lock "cinder-quobyte-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124" acquired by "delete_volume" :: waited 0.038s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[7361aa73-5586-46c8-b4ca-d4e0e65c5a6e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:05 devstack sudo[90738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124
Sep 09 03:52:05 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:06 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de 1073741824" returned: 0 in 0.582s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-17cb0214-6e32-47cc-a696-7b680b78b85d req-03cee2b1-ad17-4168-ae23-d756cc219ac0 tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:06 devstack sudo[90748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de
Sep 09 03:52:06 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:06 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124" returned: 0 in 0.418s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:06 devstack sudo[90753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124
Sep 09 03:52:06 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:06 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de" returned: 0 in 0.255s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-17cb0214-6e32-47cc-a696-7b680b78b85d req-03cee2b1-ad17-4168-ae23-d756cc219ac0 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.264s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f32f12d-9b39-4e46-8960-5cb3a526cfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d121f9a-1fe5-412e-acb2-f6967780a8de', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36be0016-0cfc-4999-83f0-034847984ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-17cb0214-6e32-47cc-a696-7b680b78b85d req-03cee2b1-ad17-4168-ae23-d756cc219ac0 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:06 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Volume volume-3d121f9a-1fe5-412e-acb2-f6967780a8de (3d121f9a-1fe5-412e-acb2-f6967780a8de): created successfully
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36be0016-0cfc-4999-83f0-034847984ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Flow 'volume_create_manager' (2729efe0-2db6-470e-8bb9-db3810e08458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:06 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-14bab8e3-3a48-4748-8628-a363a1923c97 tempest-GroupSnapshotsTest-2146613640 None] Created volume successfully.
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-17cb0214-6e32-47cc-a696-7b680b78b85d req-03cee2b1-ad17-4168-ae23-d756cc219ac0 tempest-AttachVolumeNegativeTest-1819164189 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5625cfc4-c0fa-4c53-9ea8-31add2ea2158', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 03:52:06 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-17cb0214-6e32-47cc-a696-7b680b78b85d req-03cee2b1-ad17-4168-ae23-d756cc219ac0 tempest-AttachVolumeNegativeTest-1819164189 None] attachment_update completed successfully.
Sep 09 03:52:06 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124" returned: 0 in 0.272s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Lock "cinder-quobyte-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124" released by "delete_volume" :: held 0.758s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:06 devstack cinder-volume[87558]: WARNING cinder.quota [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:52:06 devstack cinder-volume[87558]: WARNING cinder.quota [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Created reservations ['0aa9a1fc-31fd-4469-bb50-4e1c9935e35c', 'd31d1493-fe12-4adc-9f79-86b1f3c116c8', '3df3e41a-5a37-4290-a980-71699aafb409', '1ace4f2d-23d8-4d80-972c-d028d610d224'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:06 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:52:06 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:06 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.310s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:06 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:52:06 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] GroupSnapshot b9a6ccde-22f8-4fcc-b887-071e08ceefa6: creating.
Sep 09 03:52:06 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Deleted volume successfully.
Sep 09 03:52:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] Group snapshot b9a6ccde-22f8-4fcc-b887-071e08ceefa6: creating. {{(pid=87558) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 09 03:52:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f8db6012-730e-4a4c-acea-1f88dc9a6fab tempest-VolumeRetypeWithoutMigrationTest-1982194705 None] Lock "cinder-6b80513f-7a8c-4cb3-b5bf-e38bcbeef124-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] Creating offline snapshot f49aec4a-51ef-4065-a369-8de40c7e9c5f of volume 3d121f9a-1fe5-412e-acb2-f6967780a8de {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:52:07 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d993c906-e64f-4e3b-8385-79e3924f40d9]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:07 devstack sudo[91142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de
Sep 09 03:52:07 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:07 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de" returned: 0 in 0.411s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:07 devstack sudo[91147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f 1G
Sep 09 03:52:07 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:07 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f 1G" returned: 0 in 0.389s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d121f9a-1fe5-412e-acb2-f6967780a8de -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:07 devstack sudo[91153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d121f9a-1fe5-412e-acb2-f6967780a8de -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f
Sep 09 03:52:07 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:08 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d121f9a-1fe5-412e-acb2-f6967780a8de -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f" returned: 0 in 0.313s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:08 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:52:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:08 devstack sudo[91158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f
Sep 09 03:52:08 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:08 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f" returned: 0 in 0.268s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:08 devstack sudo[91161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.info
Sep 09 03:52:08 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:08 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.info" returned: 0 in 0.318s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:08 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:52:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:08 devstack sudo[91165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.info
Sep 09 03:52:08 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:09 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-1db36a76-a8e5-486d-9d06-35ec22a1d612 req-24517606-e5c1-4a4f-aa35-26f9d855fbfe tempest-AttachVolumeNegativeTest-1819164189 None] Terminate volume connection completed successfully.
Sep 09 03:52:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-1db36a76-a8e5-486d-9d06-35ec22a1d612 req-24517606-e5c1-4a4f-aa35-26f9d855fbfe tempest-AttachVolumeNegativeTest-1819164189 None] Deleting attachment 5625cfc4-c0fa-4c53-9ea8-31add2ea2158. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 03:52:09 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.info" returned: 0 in 0.402s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:09 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-376ec93e-57a6-476b-afdd-f6bb2f693012 tempest-GroupSnapshotsTest-2146613640 None] group_snapshot b9a6ccde-22f8-4fcc-b887-071e08ceefa6: created successfully
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-f49aec4a-51ef-4065-a369-8de40c7e9c5f-982fe08e-1c62-4f0b-b700-be0cadc357d2" by "_create_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-f49aec4a-51ef-4065-a369-8de40c7e9c5f-982fe08e-1c62-4f0b-b700-be0cadc357d2" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Creating volume 982fe08e-1c62-4f0b-b700-be0cadc357d2 from snapshot f49aec4a-51ef-4065-a369-8de40c7e9c5f {{(pid=87558) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-982fe08e-1c62-4f0b-b700-be0cadc357d2" by "_copy_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-982fe08e-1c62-4f0b-b700-be0cadc357d2" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] snapshot: f49aec4a-51ef-4065-a369-8de40c7e9c5f, volume: 982fe08e-1c62-4f0b-b700-be0cadc357d2,  {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d2b6ef-7a73-41fc-99d8-a7d50e4bb442]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:11 devstack sudo[91219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f
Sep 09 03:52:11 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:12 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f" returned: 0 in 0.601s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d121f9a-1fe5-412e-acb2-f6967780a8de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:52:12 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[9add2cf3-6554-469b-a89b-8451f7d83ea3]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:12 devstack sudo[91226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de
Sep 09 03:52:12 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:12 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de" returned: 0 in 0.472s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 03:52:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Creating direct copy from snapshot {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 03:52:12 devstack cinder-volume[87558]: DEBUG cinder.utils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Path /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2 not found in is_blk_device check {{(pid=87558) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 03:52:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:12 devstack sudo[91231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2
Sep 09 03:52:12 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:52:19 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Flow 'volume_create_manager' (1b23f761-299b-4895-9892-28e989632ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b534d43-99bf-4723-8d94-47c5ed95959c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2" returned: 0 in 6.616s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2 {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 03:52:19 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Converted 1024.00 MB image at 154.74 MB/s
Sep 09 03:52:19 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2 is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:19 devstack sudo[91265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2
Sep 09 03:52:19 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b534d43-99bf-4723-8d94-47c5ed95959c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1972626842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f77a03-229c-4b74-80da-ea71a6add0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ac2d1341304a888cebd2b490ee83c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:19Z,use_quota=True,user_id='6daa749fbe2d43afbac071140415829f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795b7a65-8b05-4ce5-8938-5d04863aae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795b7a65-8b05-4ce5-8938-5d04863aae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c3d5e4-a9a1-4689-9a49-43aed8b725b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c3d5e4-a9a1-4689-9a49-43aed8b725b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f77a03-229c-4b74-80da-ea71a6add0e4', 'volume_name': 'volume-a8f77a03-229c-4b74-80da-ea71a6add0e4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a3cc89-6c3e-471c-ba82-af05929a01e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a3cc89-6c3e-471c-ba82-af05929a01e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2634f394-d13c-4dc2-b201-236ebe137361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:19 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Volume a8f77a03-229c-4b74-80da-ea71a6add0e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f77a03-229c-4b74-80da-ea71a6add0e4', 'volume_size': 1}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Flow 'volume_create_manager' (77982f4e-fd85-469c-a325-516f14cc347c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1ff3ad-2d15-4f2e-8c62-d4882ca27087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1ff3ad-2d15-4f2e-8c62-d4882ca27087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1542287936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3e20a0-5c04-46f2-9318-69e6e74a24d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f4944b369444db4f88d7c0b3047fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:19Z,use_quota=True,user_id='cc2a8b7a845b4b5893df31a8970aef51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f8adcb-a38f-4d72-ab53-139b23d2e33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f8adcb-a38f-4d72-ab53-139b23d2e33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59e4054-19c5-4e35-a678-62ea84129714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59e4054-19c5-4e35-a678-62ea84129714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f3e20a0-5c04-46f2-9318-69e6e74a24d4', 'volume_name': 'volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a96386c-89f0-4c43-bdea-ddae8b398f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a96386c-89f0-4c43-bdea-ddae8b398f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afce9b0-ccd9-4831-882e-dac1048174be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:19 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Volume 2f3e20a0-5c04-46f2-9318-69e6e74a24d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4', 'volume_size': 1}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:19 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2" returned: 0 in 0.382s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-982fe08e-1c62-4f0b-b700-be0cadc357d2" released by "_copy_volume_from_snapshot" :: held 8.202s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-f49aec4a-51ef-4065-a369-8de40c7e9c5f-982fe08e-1c62-4f0b-b700-be0cadc357d2" released by "_create_volume_from_snapshot" :: held 8.288s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.305s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.355s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1972626842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f77a03-229c-4b74-80da-ea71a6add0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ac2d1341304a888cebd2b490ee83c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:19Z,use_quota=True,user_id='6daa749fbe2d43afbac071140415829f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Creating volume a8f77a03-229c-4b74-80da-ea71a6add0e4 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:52:19 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:52:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a8f77a03-229c-4b74-80da-ea71a6add0e4 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:19 devstack sudo[91268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a8f77a03-229c-4b74-80da-ea71a6add0e4 1073741824
Sep 09 03:52:19 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:19 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-1551e736-9040-4c5f-a104-b2115849a79b tempest-GroupSnapshotsTest-2146613640 None] Create group from source-snapshot-b9a6ccde-22f8-4fcc-b887-071e08ceefa6 completed successfully.
Sep 09 03:52:20 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a8f77a03-229c-4b74-80da-ea71a6add0e4 1073741824" returned: 0 in 0.534s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a8f77a03-229c-4b74-80da-ea71a6add0e4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:20 devstack sudo[91274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a8f77a03-229c-4b74-80da-ea71a6add0e4
Sep 09 03:52:20 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:20 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a8f77a03-229c-4b74-80da-ea71a6add0e4" returned: 0 in 0.278s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.053s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1542287936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3e20a0-5c04-46f2-9318-69e6e74a24d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f4944b369444db4f88d7c0b3047fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:19Z,use_quota=True,user_id='cc2a8b7a845b4b5893df31a8970aef51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Creating volume 2f3e20a0-5c04-46f2-9318-69e6e74a24d4 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:52:20 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2634f394-d13c-4dc2-b201-236ebe137361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f77a03-229c-4b74-80da-ea71a6add0e4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:20 devstack sudo[91277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4 1073741824
Sep 09 03:52:20 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d606a326-db16-461e-ab90-0c331c45caf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:20 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Volume volume-a8f77a03-229c-4b74-80da-ea71a6add0e4 (a8f77a03-229c-4b74-80da-ea71a6add0e4): created successfully
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d606a326-db16-461e-ab90-0c331c45caf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Flow 'volume_create_manager' (1b23f761-299b-4895-9892-28e989632ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:20 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-72ebb327-2137-41c5-a1af-e1461aca4609 tempest-ServerActionsTestOtherA-1293361095 None] Created volume successfully.
Sep 09 03:52:21 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4 1073741824" returned: 0 in 0.598s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:21 devstack sudo[91284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4
Sep 09 03:52:21 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-982fe08e-1c62-4f0b-b700-be0cadc357d2" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-982fe08e-1c62-4f0b-b700-be0cadc357d2" acquired by "delete_volume" :: waited 0.034s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1868ced7-7330-4585-b1fe-9f73e9311bd5]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:21 devstack sudo[91288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2
Sep 09 03:52:21 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:21 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4" returned: 0 in 0.394s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afce9b0-ccd9-4831-882e-dac1048174be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71085a1-0ee9-4c82-9754-c856fd07dfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:21 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Volume volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4 (2f3e20a0-5c04-46f2-9318-69e6e74a24d4): created successfully
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71085a1-0ee9-4c82-9754-c856fd07dfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Flow 'volume_create_manager' (77982f4e-fd85-469c-a325-516f14cc347c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:21 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c105810a-0542-4c63-a89a-f8ae59dff7dc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Created volume successfully.
Sep 09 03:52:21 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2" returned: 0 in 0.477s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:21 devstack sudo[91300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2
Sep 09 03:52:21 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:22 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982fe08e-1c62-4f0b-b700-be0cadc357d2" returned: 0 in 0.295s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:22 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-982fe08e-1c62-4f0b-b700-be0cadc357d2" released by "delete_volume" :: held 0.836s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:22 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Created reservations ['e5dafe35-5f79-4d4c-a4ef-bce77e8bf0ad'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:52:22 devstack cinder-volume[87558]: WARNING cinder.quota [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1045219952 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1045219952, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:52:22 devstack cinder-volume[87558]: WARNING cinder.quota [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1045219952 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1045219952, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:52:22 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Created reservations ['11a44915-5fde-43a8-9aa7-b9001b706450', '1532d4ce-bbf7-4682-8c3d-3708bab8d096', '6e12e224-6c2a-4594-a600-71815175f00f', '57990680-191a-44d1-a555-259f02981976'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:52:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:22 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:22 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:22 devstack sudo[91308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:52:22 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:22 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.309s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:22 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:52:22 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-49ffd152-973f-426c-bc06-baef8f62ff9a tempest-GroupSnapshotsTest-2146613640 None] Delete group completed successfully.
Sep 09 03:52:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Creating offline snapshot ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f of volume 2f3e20a0-5c04-46f2-9318-69e6e74a24d4 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:52:23 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd6ded1-fb8f-4c60-9bd8-4a3c6fa0ef93]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:23 devstack sudo[91312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4
Sep 09 03:52:23 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:23 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4" returned: 0 in 0.467s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:23 devstack sudo[91334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f 1G
Sep 09 03:52:23 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:23 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] group_snapshot b9a6ccde-22f8-4fcc-b887-071e08ceefa6: deleting
Sep 09 03:52:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] group_snapshot b9a6ccde-22f8-4fcc-b887-071e08ceefa6: deleting {{(pid=87558) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-3d121f9a-1fe5-412e-acb2-f6967780a8de" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-3d121f9a-1fe5-412e-acb2-f6967780a8de" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-f49aec4a-51ef-4065-a369-8de40c7e9c5f" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-f49aec4a-51ef-4065-a369-8de40c7e9c5f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Deleting offline snapshot f49aec4a-51ef-4065-a369-8de40c7e9c5f of volume 3d121f9a-1fe5-412e-acb2-f6967780a8de {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] snapshot_file for this snap is: volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e62b5e5-c698-434b-ac04-e9e920f5fd8e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:24 devstack sudo[91343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f
Sep 09 03:52:24 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:24 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f 1G" returned: 0 in 0.866s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:24 devstack sudo[91347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f
Sep 09 03:52:24 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:24 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f" returned: 0 in 0.584s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d121f9a-1fe5-412e-acb2-f6967780a8de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2a3399-e848-4173-bda5-7507cf4d1f0e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:25 devstack sudo[91353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de
Sep 09 03:52:25 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:25 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f" returned: 0 in 0.525s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:25 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f is being set with open permissions: ugo+rw
Sep 09 03:52:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:25 devstack sudo[91362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f
Sep 09 03:52:25 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:25 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f" returned: 0 in 0.484s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:25 devstack sudo[91382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.info
Sep 09 03:52:25 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:25 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de" returned: 0 in 0.970s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:25 devstack sudo[91384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f
Sep 09 03:52:25 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:25 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.info" returned: 0 in 0.330s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:26 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.info is being set with open permissions: ugo+rw
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:26 devstack sudo[91387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.info
Sep 09 03:52:26 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:26 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f" returned: 0 in 0.508s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:26 devstack sudo[91395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f
Sep 09 03:52:26 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:26 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.info" returned: 0 in 0.377s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.196s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:26 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-dc058c08-741b-41a5-84d8-e9bb143746f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Create snapshot completed successfully
Sep 09 03:52:26 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de.f49aec4a-51ef-4065-a369-8de40c7e9c5f" returned: 0 in 0.306s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-f49aec4a-51ef-4065-a369-8de40c7e9c5f" released by "_delete_snapshot" :: held 2.575s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-3d121f9a-1fe5-412e-acb2-f6967780a8de" released by "delete_snapshot" :: held 2.617s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:26 devstack cinder-volume[87558]: WARNING cinder.quota [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1045219952 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1045219952, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] Created reservations ['8db086b8-fdac-48d8-9d2a-a8bd7621094e', '037d1d36-164c-4a98-81b8-1523ecb9cf15', '72d4fcee-0f9d-45f5-8b60-205435d91896', '8685a8ba-c51a-4a25-b48e-f5387ee88aa2'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:27 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b97fb106-8d88-49de-99ac-2c9a29a4dd51 tempest-GroupSnapshotsTest-2146613640 None] group_snapshot b9a6ccde-22f8-4fcc-b887-071e08ceefa6: deleted successfully
Sep 09 03:52:27 devstack sudo[91419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:52:27 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:27 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.654s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:52:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:52:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 8 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 03:52:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 03:52:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-3d121f9a-1fe5-412e-acb2-f6967780a8de" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-3d121f9a-1fe5-412e-acb2-f6967780a8de" acquired by "delete_volume" :: waited 0.040s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:28 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9077e3-f47b-4639-9963-91af4473359c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:28 devstack sudo[91469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de
Sep 09 03:52:28 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Acquiring lock "cinder-ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "cinder-ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Acquiring lock "cinder-quobyte-2f3e20a0-5c04-46f2-9318-69e6e74a24d4" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "cinder-quobyte-2f3e20a0-5c04-46f2-9318-69e6e74a24d4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Acquiring lock "cinder-quobyte-ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "cinder-quobyte-ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Deleting offline snapshot ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f of volume 2f3e20a0-5c04-46f2-9318-69e6e74a24d4 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] snapshot_file for this snap is: volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[96910583-24d1-43ce-9a81-f1e130c691e8]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:29 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de" returned: 0 in 0.725s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:29 devstack sudo[91479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de
Sep 09 03:52:29 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:29 devstack sudo[91478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f
Sep 09 03:52:29 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:29 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f" returned: 0 in 0.735s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:52:29 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3d121f9a-1fe5-412e-acb2-f6967780a8de" returned: 0 in 0.805s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a94852-8a96-4958-8660-25013cc09c2e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-3d121f9a-1fe5-412e-acb2-f6967780a8de" released by "delete_volume" :: held 1.724s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:30 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Created reservations ['1e017e50-4470-4450-bb5b-fd36d041b1b2'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:52:30 devstack sudo[91514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4
Sep 09 03:52:30 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:30 devstack cinder-volume[87558]: WARNING cinder.db.api [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1045219952']
Sep 09 03:52:30 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Created reservations ['fec10be4-c74e-4a89-a3b6-122006b17849', 'ca355b77-4f30-413f-9458-75d22ac52a27', 'fd4f95e0-5ec6-46ac-bea2-566b70b98581', '3b9e3c51-c982-4d70-8094-bc1b72ae7660'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:52:30 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4" returned: 0 in 0.775s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:30 devstack sudo[91534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f
Sep 09 03:52:30 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:30 devstack sudo[91536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:52:30 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:31 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f" returned: 0 in 0.714s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:31 devstack sudo[91541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f
Sep 09 03:52:31 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:31 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.765s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:31 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:52:31 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6e96ec14-ea37-443c-8ebd-74b1a3f0a327 tempest-GroupSnapshotsTest-2146613640 None] Delete group completed successfully.
Sep 09 03:52:32 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4.ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f" returned: 0 in 0.858s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "cinder-quobyte-ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f" released by "_delete_snapshot" :: held 3.414s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "cinder-quobyte-2f3e20a0-5c04-46f2-9318-69e6e74a24d4" released by "delete_snapshot" :: held 3.458s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:32 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-25fe9dc3-bd6f-4444-9052-2a73249e78d8 tempest-GroupSnapshotsTest-2146613640 None] Group tempest-GroupSnapshotsTest-Group-395853894: creating
Sep 09 03:52:32 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-25fe9dc3-bd6f-4444-9052-2a73249e78d8 tempest-GroupSnapshotsTest-2146613640 None] Group tempest-GroupSnapshotsTest-Group-395853894: created successfully
Sep 09 03:52:32 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-25fe9dc3-bd6f-4444-9052-2a73249e78d8 tempest-GroupSnapshotsTest-2146613640 None] Create group completed successfully.
Sep 09 03:52:32 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Created reservations ['faa7910d-a9c9-4fb8-9c9a-f734e60d3611', 'f4772593-9e31-43b5-92af-56f4aa55c323', 'ccc24802-f739-4640-b556-839045725240', '1ff90974-ed5a-4733-b7f6-c901122f9408'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:52:32 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Delete snapshot completed successfully.
Sep 09 03:52:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-44467f9d-ff65-4e52-aa5b-ad6302f490cc tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "cinder-ba3b73a4-ce90-4dd6-90d7-ccd44513ce2f-delete_snapshot" released by "delete_snapshot" :: held 3.719s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Acquiring lock "cinder-2f3e20a0-5c04-46f2-9318-69e6e74a24d4-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "cinder-2f3e20a0-5c04-46f2-9318-69e6e74a24d4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Acquiring lock "cinder-quobyte-2f3e20a0-5c04-46f2-9318-69e6e74a24d4" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "cinder-quobyte-2f3e20a0-5c04-46f2-9318-69e6e74a24d4" acquired by "delete_volume" :: waited 0.043s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:33 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fc8acf-a65a-479b-a5c1-8f1a52cab847]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:34 devstack sudo[91553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4
Sep 09 03:52:34 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:34 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4" returned: 0 in 0.802s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:34 devstack sudo[91559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4
Sep 09 03:52:34 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:34 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:52:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Flow 'volume_create_manager' (eece7865-4277-4644-9de3-24108ff64fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e4d396-78a5-4052-a59d-320b26c9e71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e4d396-78a5-4052-a59d-320b26c9e71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-677226943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77c4373a-1f55-4872-8e99-21219aaa95f0,host='devstack@QuobyteHD#QuobyteHD',id=249f6de5-a521-4c45-9e6e-c3d7638427af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cbd3b7885e4cfd8139d19e6a5b578e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:35Z,use_quota=True,user_id='9893879908944d4f82bb7619627bdc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(996a2687-6ea2-4e69-9f3f-cd306cbda41b),volume_type_id=996a2687-6ea2-4e69-9f3f-cd306cbda41b)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7e003a-585d-411f-878a-c29236653be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7e003a-585d-411f-878a-c29236653be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7456bd6a-9511-470a-a3ba-43dc915f545a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7456bd6a-9511-470a-a3ba-43dc915f545a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '249f6de5-a521-4c45-9e6e-c3d7638427af', 'volume_name': 'volume-249f6de5-a521-4c45-9e6e-c3d7638427af', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c2c2f0-ae1f-40e3-8e69-5a386d78a715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:35 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c2c2f0-ae1f-40e3-8e69-5a386d78a715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5db50a1-0911-48ab-a744-be4fda3b9ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:35 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Volume 249f6de5-a521-4c45-9e6e-c3d7638427af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-249f6de5-a521-4c45-9e6e-c3d7638427af', 'volume_size': 1}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=77c4373a-1f55-4872-8e99-21219aaa95f0,created_at=2026-09-09T01:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-677226943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77c4373a-1f55-4872-8e99-21219aaa95f0,host='devstack@QuobyteHD#QuobyteHD',id=249f6de5-a521-4c45-9e6e-c3d7638427af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cbd3b7885e4cfd8139d19e6a5b578e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:35Z,use_quota=True,user_id='9893879908944d4f82bb7619627bdc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(996a2687-6ea2-4e69-9f3f-cd306cbda41b),volume_type_id=996a2687-6ea2-4e69-9f3f-cd306cbda41b)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Creating volume 249f6de5-a521-4c45-9e6e-c3d7638427af {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:52:35 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2f3e20a0-5c04-46f2-9318-69e6e74a24d4" returned: 0 in 0.538s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:35 devstack sudo[91564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af 1073741824
Sep 09 03:52:35 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "cinder-quobyte-2f3e20a0-5c04-46f2-9318-69e6e74a24d4" released by "delete_volume" :: held 1.487s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Created reservations ['4ec16e8a-8094-41e8-ac09-8c8892f13548', 'de6e43c3-2cf8-46a3-ba01-2099e367aef8', '2ac89a1d-ced0-4370-ad00-15338e963a2d', '0548cf62-4d4d-434c-90f4-4c807e435804'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:35 devstack sudo[91568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:52:35 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:35 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.304s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:52:35 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Deleted volume successfully.
Sep 09 03:52:35 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-902d623a-b4c8-4911-a732-39381faf49a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-492910109 None] Lock "cinder-2f3e20a0-5c04-46f2-9318-69e6e74a24d4-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af 1073741824" returned: 0 in 0.731s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:35 devstack sudo[91573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af
Sep 09 03:52:35 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:36 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af" returned: 0 in 0.371s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:52:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5db50a1-0911-48ab-a744-be4fda3b9ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249f6de5-a521-4c45-9e6e-c3d7638427af', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36725ae8-8a40-451a-b846-1bd8147aa239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:36 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Volume volume-249f6de5-a521-4c45-9e6e-c3d7638427af (249f6de5-a521-4c45-9e6e-c3d7638427af): created successfully
Sep 09 03:52:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36725ae8-8a40-451a-b846-1bd8147aa239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Flow 'volume_create_manager' (eece7865-4277-4644-9de3-24108ff64fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:36 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e4ab5263-772a-4d14-922d-c4db46b2d79f tempest-GroupSnapshotsTest-2146613640 None] Created volume successfully.
Sep 09 03:52:38 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:52:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Flow 'volume_create_manager' (03ddfcae-9fb8-472e-a666-66dd51b21cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bf857b-d0fd-4457-b1c5-65bc9d809d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bf857b-d0fd-4457-b1c5-65bc9d809d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1988110880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77c4373a-1f55-4872-8e99-21219aaa95f0,host='devstack@QuobyteHD#QuobyteHD',id=81ffa332-f477-48f5-ade9-c63b8c03559e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cbd3b7885e4cfd8139d19e6a5b578e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:39Z,use_quota=True,user_id='9893879908944d4f82bb7619627bdc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(996a2687-6ea2-4e69-9f3f-cd306cbda41b),volume_type_id=996a2687-6ea2-4e69-9f3f-cd306cbda41b)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b4ccb7-f875-4620-ae5f-df9296deaeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b4ccb7-f875-4620-ae5f-df9296deaeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea71e3b7-ec51-4c64-88ab-30691edc789d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea71e3b7-ec51-4c64-88ab-30691edc789d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81ffa332-f477-48f5-ade9-c63b8c03559e', 'volume_name': 'volume-81ffa332-f477-48f5-ade9-c63b8c03559e', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cacf81-010d-4445-916f-321fdb65c762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cacf81-010d-4445-916f-321fdb65c762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a7c297-1dd0-4aa9-b791-90ca22387e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:39 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Volume 81ffa332-f477-48f5-ade9-c63b8c03559e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81ffa332-f477-48f5-ade9-c63b8c03559e', 'volume_size': 1}
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=77c4373a-1f55-4872-8e99-21219aaa95f0,created_at=2026-09-09T01:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1988110880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77c4373a-1f55-4872-8e99-21219aaa95f0,host='devstack@QuobyteHD#QuobyteHD',id=81ffa332-f477-48f5-ade9-c63b8c03559e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cbd3b7885e4cfd8139d19e6a5b578e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:39Z,use_quota=True,user_id='9893879908944d4f82bb7619627bdc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(996a2687-6ea2-4e69-9f3f-cd306cbda41b),volume_type_id=996a2687-6ea2-4e69-9f3f-cd306cbda41b)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Creating volume 81ffa332-f477-48f5-ade9-c63b8c03559e {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:52:39 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:39 devstack sudo[91579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e 1073741824
Sep 09 03:52:39 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:39 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e 1073741824" returned: 0 in 0.585s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:39 devstack sudo[91584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e
Sep 09 03:52:39 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:40 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e" returned: 0 in 0.416s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:52:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a7c297-1dd0-4aa9-b791-90ca22387e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ffa332-f477-48f5-ade9-c63b8c03559e', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4baf041c-7116-4feb-9814-c9f23ce83d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:40 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Volume volume-81ffa332-f477-48f5-ade9-c63b8c03559e (81ffa332-f477-48f5-ade9-c63b8c03559e): created successfully
Sep 09 03:52:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4baf041c-7116-4feb-9814-c9f23ce83d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Flow 'volume_create_manager' (03ddfcae-9fb8-472e-a666-66dd51b21cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:40 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d6253f60-45c5-4e29-aa50-8bae15258285 tempest-GroupSnapshotsTest-2146613640 None] Created volume successfully.
Sep 09 03:52:41 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d7fab70e-fdfc-478e-a033-46597f31b65f tempest-GroupSnapshotsTest-2146613640 None] Update group completed successfully.
Sep 09 03:52:42 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6451b421-1910-4225-8806-0f3efe25275f tempest-GroupSnapshotsTest-2146613640 None] Update group completed successfully.
Sep 09 03:52:44 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-07573b30-e2c4-4acc-93c5-d73746408a14 tempest-GroupSnapshotsTest-2146613640 None] Update group completed successfully.
Sep 09 03:52:45 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8690d197-c41c-4984-a741-2e11d4509204 tempest-GroupSnapshotsTest-2146613640 None] Update group completed successfully.
Sep 09 03:52:46 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] GroupSnapshot 1005e1d6-10fc-4033-b0d7-514a7057e364: creating.
Sep 09 03:52:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Group snapshot 1005e1d6-10fc-4033-b0d7-514a7057e364: creating. {{(pid=87558) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 09 03:52:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Creating offline snapshot 0efebc72-e1b9-4950-966e-cee340ba2f40 of volume 81ffa332-f477-48f5-ade9-c63b8c03559e {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:52:47 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec6e0e4-97b3-4ec4-86e2-ad85813ba1fb]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:47 devstack sudo[91651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e
Sep 09 03:52:47 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:47 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e" returned: 0 in 0.408s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:47 devstack sudo[91656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40 1G
Sep 09 03:52:47 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:47 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40 1G" returned: 0 in 0.450s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81ffa332-f477-48f5-ade9-c63b8c03559e -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:47 devstack sudo[91662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81ffa332-f477-48f5-ade9-c63b8c03559e -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40
Sep 09 03:52:47 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:48 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81ffa332-f477-48f5-ade9-c63b8c03559e -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40" returned: 0 in 0.317s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:48 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40 is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:52:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:48 devstack sudo[91667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40
Sep 09 03:52:48 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:48 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40" returned: 0 in 0.259s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:48 devstack sudo[91670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.info
Sep 09 03:52:48 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:48 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.info" returned: 0 in 0.261s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:48 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:52:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:48 devstack sudo[91673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.info
Sep 09 03:52:48 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:48 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.info" returned: 0 in 0.268s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.086s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Creating offline snapshot 81e8f5e7-7ce8-4980-88ae-8b6662858307 of volume 249f6de5-a521-4c45-9e6e-c3d7638427af {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:52:49 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbe5503-445c-4610-9b3b-aba129950854]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:49 devstack sudo[91676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af
Sep 09 03:52:49 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:49 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af" returned: 0 in 0.405s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:49 devstack sudo[91681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307 1G
Sep 09 03:52:49 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:50 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307 1G" returned: 0 in 0.514s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-249f6de5-a521-4c45-9e6e-c3d7638427af -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:50 devstack sudo[91687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-249f6de5-a521-4c45-9e6e-c3d7638427af -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307
Sep 09 03:52:50 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:50 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-249f6de5-a521-4c45-9e6e-c3d7638427af -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307" returned: 0 in 0.373s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:50 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307 is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:52:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:50 devstack sudo[91693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307
Sep 09 03:52:50 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:50 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307" returned: 0 in 0.293s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:50 devstack sudo[91696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.info
Sep 09 03:52:50 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:50 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.info" returned: 0 in 0.269s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:50 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:52:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:50 devstack sudo[91699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.info
Sep 09 03:52:50 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:51 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.info" returned: 0 in 0.258s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.210s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6eee989d-7ad1-4682-8766-e6703c6a8501 tempest-GroupSnapshotsTest-2146613640 None] group_snapshot 1005e1d6-10fc-4033-b0d7-514a7057e364: created successfully
Sep 09 03:52:52 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] group_snapshot 1005e1d6-10fc-4033-b0d7-514a7057e364: deleting
Sep 09 03:52:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] group_snapshot 1005e1d6-10fc-4033-b0d7-514a7057e364: deleting {{(pid=87558) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 09 03:52:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-81ffa332-f477-48f5-ade9-c63b8c03559e" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-81ffa332-f477-48f5-ade9-c63b8c03559e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-0efebc72-e1b9-4950-966e-cee340ba2f40" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-0efebc72-e1b9-4950-966e-cee340ba2f40" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Deleting offline snapshot 0efebc72-e1b9-4950-966e-cee340ba2f40 of volume 81ffa332-f477-48f5-ade9-c63b8c03559e {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:52:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] snapshot_file for this snap is: volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:52:52 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23bc0b2-b7f7-4539-bb6e-56b45aa2dcc1]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:52 devstack sudo[91702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40
Sep 09 03:52:52 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:52 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40" returned: 0 in 0.400s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81ffa332-f477-48f5-ade9-c63b8c03559e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:52:52 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[02725d7c-87ba-4c84-b9d5-b270bd85e4b3]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:53 devstack sudo[91707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e
Sep 09 03:52:53 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:53 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e" returned: 0 in 0.450s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:53 devstack sudo[91714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40
Sep 09 03:52:53 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Flow 'volume_create_manager' (247c101c-c175-47f1-a6e5-589cf5e204b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e09396-724d-4035-a58c-bc6796b2a4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e09396-724d-4035-a58c-bc6796b2a4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1977516597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40a63fdfcb24ab693ff2eb62df5dbb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:54Z,use_quota=True,user_id='947f262f59124836bd037a506ed24697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8837226e-3f41-44fa-8a7f-38d7c7cdaa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8837226e-3f41-44fa-8a7f-38d7c7cdaa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ae2f7d-39de-40a9-9b0b-7cb7a66c3979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ae2f7d-39de-40a9-9b0b-7cb7a66c3979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9', 'volume_name': 'volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b895faa-fb2a-47b6-b877-f0943ff885f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b895faa-fb2a-47b6-b877-f0943ff885f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ea3406-b274-480f-8596-20ca97b24b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:53 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Volume 1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9', 'volume_size': 1}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1977516597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40a63fdfcb24ab693ff2eb62df5dbb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:54Z,use_quota=True,user_id='947f262f59124836bd037a506ed24697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Creating volume 1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:52:53 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:53 devstack sudo[91719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9 1073741824
Sep 09 03:52:53 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Flow 'volume_create_manager' (6ba81bd8-57de-445f-b1b0-3296e2ab865d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8017bf-5862-45ed-ab3b-b5d563c39741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:53 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8017bf-5862-45ed-ab3b-b5d563c39741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-418511673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df4c944-d9b5-4070-b9b1-bc0a34273743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1221a30670e54bbcb80698a594e6c130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:54Z,use_quota=True,user_id='df0acdad6628427eabac22bceef94f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84287d0-a4f0-456c-b09a-c86591e025b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84287d0-a4f0-456c-b09a-c86591e025b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28742fb-c00a-421b-b346-0c27a4ace6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28742fb-c00a-421b-b346-0c27a4ace6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df4c944-d9b5-4070-b9b1-bc0a34273743', 'volume_name': 'volume-6df4c944-d9b5-4070-b9b1-bc0a34273743', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc19d56-23b6-48ca-b43d-aa040721ef06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc19d56-23b6-48ca-b43d-aa040721ef06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea404e19-611d-4870-ba4d-9c55786e4e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:53 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Volume 6df4c944-d9b5-4070-b9b1-bc0a34273743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df4c944-d9b5-4070-b9b1-bc0a34273743', 'volume_size': 1}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40" returned: 0 in 0.612s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:53 devstack sudo[91721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40
Sep 09 03:52:53 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:54 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9 1073741824" returned: 0 in 0.481s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:54 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e.0efebc72-e1b9-4950-966e-cee340ba2f40" returned: 0 in 0.289s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-0efebc72-e1b9-4950-966e-cee340ba2f40" released by "_delete_snapshot" :: held 1.860s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-81ffa332-f477-48f5-ade9-c63b8c03559e" released by "delete_snapshot" :: held 1.888s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-249f6de5-a521-4c45-9e6e-c3d7638427af" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-249f6de5-a521-4c45-9e6e-c3d7638427af" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-81e8f5e7-7ce8-4980-88ae-8b6662858307" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:54 devstack sudo[91728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9
Sep 09 03:52:54 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-81e8f5e7-7ce8-4980-88ae-8b6662858307" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Deleting offline snapshot 81e8f5e7-7ce8-4980-88ae-8b6662858307 of volume 249f6de5-a521-4c45-9e6e-c3d7638427af {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] snapshot_file for this snap is: volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beecb2f-bdc6-4d1e-a9c1-9120f51eb2f9]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:54 devstack sudo[91730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307
Sep 09 03:52:54 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:54 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9" returned: 0 in 0.281s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.660s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-418511673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df4c944-d9b5-4070-b9b1-bc0a34273743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1221a30670e54bbcb80698a594e6c130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:54Z,use_quota=True,user_id='df0acdad6628427eabac22bceef94f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Creating volume 6df4c944-d9b5-4070-b9b1-bc0a34273743 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:52:54 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6df4c944-d9b5-4070-b9b1-bc0a34273743 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:54 devstack sudo[91734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6df4c944-d9b5-4070-b9b1-bc0a34273743 1073741824
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ea3406-b274-480f-8596-20ca97b24b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:54 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6adcb2b-0442-4520-ba53-131aefafd40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:54 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Volume volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9 (1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9): created successfully
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6adcb2b-0442-4520-ba53-131aefafd40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Flow 'volume_create_manager' (247c101c-c175-47f1-a6e5-589cf5e204b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:54 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7f5aa20a-6a20-439c-9472-5a042eaa38d6 tempest-AbsoluteLimitsTests-1743193537 None] Created volume successfully.
Sep 09 03:52:54 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307" returned: 0 in 0.434s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-249f6de5-a521-4c45-9e6e-c3d7638427af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d30a37-32fd-4c91-9ee8-4490d9a93181]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:54 devstack sudo[91740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af
Sep 09 03:52:54 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:55 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6df4c944-d9b5-4070-b9b1-bc0a34273743 1073741824" returned: 0 in 0.491s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6df4c944-d9b5-4070-b9b1-bc0a34273743 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:55 devstack sudo[91745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6df4c944-d9b5-4070-b9b1-bc0a34273743
Sep 09 03:52:55 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:55 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af" returned: 0 in 0.451s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:55 devstack sudo[91750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307
Sep 09 03:52:55 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:55 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6df4c944-d9b5-4070-b9b1-bc0a34273743" returned: 0 in 0.324s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea404e19-611d-4870-ba4d-9c55786e4e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df4c944-d9b5-4070-b9b1-bc0a34273743', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13d2328-c84f-4838-8119-a9324313505c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:52:55 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Volume volume-6df4c944-d9b5-4070-b9b1-bc0a34273743 (6df4c944-d9b5-4070-b9b1-bc0a34273743): created successfully
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13d2328-c84f-4838-8119-a9324313505c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Flow 'volume_create_manager' (6ba81bd8-57de-445f-b1b0-3296e2ab865d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:52:55 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-5de87da8-d822-42f6-b7a8-1cfde494fd9f tempest-AttachVolumeNegativeTest-1819164189 None] Created volume successfully.
Sep 09 03:52:55 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307" returned: 0 in 0.391s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:55 devstack sudo[91757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307
Sep 09 03:52:55 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Acquiring lock "cinder-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Lock "cinder-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:55 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=93,cinder:SELECT=107,cinder:DELETE=9,cinder:INSERT=22 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Acquiring lock "cinder-quobyte-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:56 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af.81e8f5e7-7ce8-4980-88ae-8b6662858307" returned: 0 in 0.302s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-81e8f5e7-7ce8-4980-88ae-8b6662858307" released by "_delete_snapshot" :: held 1.678s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Lock "cinder-quobyte-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9" acquired by "delete_volume" :: waited 0.052s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-249f6de5-a521-4c45-9e6e-c3d7638427af" released by "delete_snapshot" :: held 1.729s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cb830f-c435-43e0-b822-d19975c6b4da]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:56 devstack cinder-volume[87558]: WARNING cinder.quota [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1542796971 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1542796971, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:52:56 devstack cinder-volume[87558]: WARNING cinder.quota [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1542796971 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1542796971, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Created reservations ['f2bfc7ec-6247-433f-99e3-daa60472dd5c', 'd8d2e31e-d632-40f9-8529-c52cfe68c6b5', '6df61d32-e396-43fc-b685-80bf9a057ce7', 'f5228c85-389f-45f6-ba40-f071faa8ba96'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:52:56 devstack sudo[91762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9
Sep 09 03:52:56 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=120,cinder:UPDATE=109,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] Created reservations ['9fe021d1-f7c4-4bcf-b4cb-646f80c4a92e', '10f86801-3d2e-4819-a666-1cf55dccf95a', '6013a428-b012-44e6-bf6a-d345ca45945b', 'dc4b5812-d317-482a-ae16-202c11242654'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:52:56 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6ad89595-63bc-4cdf-bf66-6f6226c3a18f tempest-GroupSnapshotsTest-2146613640 None] group_snapshot 1005e1d6-10fc-4033-b0d7-514a7057e364: deleted successfully
Sep 09 03:52:56 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9" returned: 0 in 0.436s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:56 devstack sudo[91805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9
Sep 09 03:52:56 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:56 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9" returned: 0 in 0.266s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Lock "cinder-quobyte-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9" released by "delete_volume" :: held 0.754s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Created reservations ['1d41b03d-2746-4da7-bd49-f53276d9fe8c', '17870547-9fe4-4dd3-9d8e-2fb5fb03fd3b', '871229b9-5850-40ff-aa18-0603f35cbcba', '5e70c601-f498-46df-b6d7-cb62e4562724'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:56 devstack sudo[91810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:52:56 devstack sudo[91810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:57 devstack sudo[91810]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.331s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:57 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:52:57 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Deleted volume successfully.
Sep 09 03:52:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-28fc958b-7f48-4b94-86f5-3f7f5e4eda55 tempest-AbsoluteLimitsTests-1743193537 None] Lock "cinder-1d3bbde4-208e-4d3b-bef1-bb3a59dbc0f9-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-249f6de5-a521-4c45-9e6e-c3d7638427af" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-257a9fed-2554-4167-bf73-151668b70ab1 req-a463ec88-3854-47cc-8941-54f081d51922 tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-257a9fed-2554-4167-bf73-151668b70ab1 req-a463ec88-3854-47cc-8941-54f081d51922 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-249f6de5-a521-4c45-9e6e-c3d7638427af" acquired by "delete_volume" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-257a9fed-2554-4167-bf73-151668b70ab1 req-a463ec88-3854-47cc-8941-54f081d51922 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.068s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:57 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13648c5-7360-4c06-8151-b26c97ad6f78]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-257a9fed-2554-4167-bf73-151668b70ab1 req-a463ec88-3854-47cc-8941-54f081d51922 tempest-AttachVolumeNegativeTest-1819164189 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-6df4c944-d9b5-4070-b9b1-bc0a34273743', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '665746fe-e939-41fd-a470-2569a31aecc7', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 03:52:57 devstack sudo[91824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af
Sep 09 03:52:57 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:57 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-257a9fed-2554-4167-bf73-151668b70ab1 req-a463ec88-3854-47cc-8941-54f081d51922 tempest-AttachVolumeNegativeTest-1819164189 None] attachment_update completed successfully.
Sep 09 03:52:58 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af" returned: 0 in 0.541s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:58 devstack sudo[92214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af
Sep 09 03:52:58 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:58 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-249f6de5-a521-4c45-9e6e-c3d7638427af" returned: 0 in 0.418s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-249f6de5-a521-4c45-9e6e-c3d7638427af" released by "delete_volume" :: held 1.049s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-81ffa332-f477-48f5-ade9-c63b8c03559e" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:52:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-81ffa332-f477-48f5-ade9-c63b8c03559e" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:52:58 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cd8b56-c940-4b2f-975e-f7233a754848]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:52:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-35951451-65eb-4ad2-bbfd-c7c6a7d67d66 req-45c2488a-cbbb-4aa0-949b-c0847651bf07 tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:52:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-35951451-65eb-4ad2-bbfd-c7c6a7d67d66 req-45c2488a-cbbb-4aa0-949b-c0847651bf07 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:52:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-35951451-65eb-4ad2-bbfd-c7c6a7d67d66 req-45c2488a-cbbb-4aa0-949b-c0847651bf07 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:52:58 devstack sudo[92227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e
Sep 09 03:52:58 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-35951451-65eb-4ad2-bbfd-c7c6a7d67d66 req-45c2488a-cbbb-4aa0-949b-c0847651bf07 tempest-ServerActionsTestOtherA-1293361095 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-a8f77a03-229c-4b74-80da-ea71a6add0e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10939125-a780-42c7-869f-54e3aa056d5d', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 03:52:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-35951451-65eb-4ad2-bbfd-c7c6a7d67d66 req-45c2488a-cbbb-4aa0-949b-c0847651bf07 tempest-ServerActionsTestOtherA-1293361095 None] attachment_update completed successfully.
Sep 09 03:52:59 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e" returned: 0 in 0.490s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:52:59 devstack sudo[92234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e
Sep 09 03:52:59 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:52:59 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root
Sep 09 03:52:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-81ffa332-f477-48f5-ade9-c63b8c03559e" returned: 0 in 0.374s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:52:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-81ffa332-f477-48f5-ade9-c63b8c03559e" released by "delete_volume" :: held 0.961s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:52:59 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Created reservations ['fd6e8746-4f8d-4a77-b638-c33bc7f6f35d'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:52:59 devstack cinder-volume[87558]: WARNING cinder.quota [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1542796971 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1542796971, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:52:59 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Created reservations ['08f42b34-ce37-4f8e-9b17-1b5d540feeee', '804af0e9-c681-42bc-8445-47f0148e3796', 'be7d2b27-bcd1-45ec-bf1f-7d66af2e0098', '1604218d-43fd-403d-943d-e31404dce855'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:00 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Created reservations ['948f1569-ee6f-4034-b46e-9014ac13b365', '0d6fa8c4-494b-4e93-bd8b-d9b5151e4a2b', '878596eb-500c-40ef-8908-5b11f574d0fc', '8d589334-7fca-4c51-a77f-7b1bc2f8c72e'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:00 devstack sudo[92239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:53:00 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:00 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.310s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:00 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:53:00 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-6a65dd27-2caa-4ad2-886d-00459e948857 req-8fb355af-bf67-4bfa-9432-faf3fb9c262f tempest-AttachVolumeNegativeTest-1819164189 None] Terminate volume connection completed successfully.
Sep 09 03:53:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-6a65dd27-2caa-4ad2-886d-00459e948857 req-8fb355af-bf67-4bfa-9432-faf3fb9c262f tempest-AttachVolumeNegativeTest-1819164189 None] Deleting attachment 665746fe-e939-41fd-a470-2569a31aecc7. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 03:53:00 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4d738615-2ed7-49c7-bd6d-a8dc58fd7ef2 tempest-GroupSnapshotsTest-2146613640 None] Delete group completed successfully.
Sep 09 03:53:01 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ff2d960b-0907-419c-9069-a54a398ad2f5 tempest-GroupSnapshotsTest-2146613640 None] Group tempest-GroupSnapshotsTest-Group-1388979973: creating
Sep 09 03:53:01 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ff2d960b-0907-419c-9069-a54a398ad2f5 tempest-GroupSnapshotsTest-2146613640 None] Group tempest-GroupSnapshotsTest-Group-1388979973: created successfully
Sep 09 03:53:02 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ff2d960b-0907-419c-9069-a54a398ad2f5 tempest-GroupSnapshotsTest-2146613640 None] Create group completed successfully.
Sep 09 03:53:03 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-1afa2c3e-a8fe-454d-9777-219d9d3218a7 req-5b2af0bf-4c22-46a8-93ae-47206b1ca670 tempest-ServerActionsTestOtherA-1293361095 None] Terminate volume connection completed successfully.
Sep 09 03:53:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-1afa2c3e-a8fe-454d-9777-219d9d3218a7 req-5b2af0bf-4c22-46a8-93ae-47206b1ca670 tempest-ServerActionsTestOtherA-1293361095 None] Deleting attachment 10939125-a780-42c7-869f-54e3aa056d5d. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Flow 'volume_create_manager' (e53743d4-c687-44fe-9b14-a914ddb79b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0f576d-902b-48f6-b887-46f05914b4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0f576d-902b-48f6-b887-46f05914b4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1550116219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e8ba2daa-0376-42a3-9385-b7deea07a786,host='devstack@QuobyteHD#QuobyteHD',id=87829d77-7b80-4a03-94cb-95d33ff3eb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cbd3b7885e4cfd8139d19e6a5b578e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:04Z,use_quota=True,user_id='9893879908944d4f82bb7619627bdc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0661d1da-0a29-44bc-8b21-15a1d478275f),volume_type_id=0661d1da-0a29-44bc-8b21-15a1d478275f)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed5c2ab-3fe6-41c1-be95-78b63f233a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed5c2ab-3fe6-41c1-be95-78b63f233a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25686a6d-b005-40af-bab0-a54ee7d29e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25686a6d-b005-40af-bab0-a54ee7d29e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87829d77-7b80-4a03-94cb-95d33ff3eb26', 'volume_name': 'volume-87829d77-7b80-4a03-94cb-95d33ff3eb26', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0bb0911-3949-4ed0-a739-a8f3166b6f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0bb0911-3949-4ed0-a739-a8f3166b6f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9037ee0-2a8e-4a30-a159-314f34c5da6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:04 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Volume 87829d77-7b80-4a03-94cb-95d33ff3eb26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87829d77-7b80-4a03-94cb-95d33ff3eb26', 'volume_size': 1}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e8ba2daa-0376-42a3-9385-b7deea07a786,created_at=2026-09-09T01:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1550116219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e8ba2daa-0376-42a3-9385-b7deea07a786,host='devstack@QuobyteHD#QuobyteHD',id=87829d77-7b80-4a03-94cb-95d33ff3eb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cbd3b7885e4cfd8139d19e6a5b578e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:04Z,use_quota=True,user_id='9893879908944d4f82bb7619627bdc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0661d1da-0a29-44bc-8b21-15a1d478275f),volume_type_id=0661d1da-0a29-44bc-8b21-15a1d478275f)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Creating volume 87829d77-7b80-4a03-94cb-95d33ff3eb26 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:53:04 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:04 devstack sudo[92323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26 1073741824
Sep 09 03:53:04 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-1afa2c3e-a8fe-454d-9777-219d9d3218a7 req-8f17f1ed-c9b2-4594-9aba-34e2f5e69ea7 tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Flow 'volume_create_manager' (afb7611d-d54c-4201-b593-fc69f78c7b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1996312a-74fe-4706-ab2e-8e23bd07c1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:04 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26 1073741824" returned: 0 in 0.680s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1996312a-74fe-4706-ab2e-8e23bd07c1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1978929131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccada78-ac16-4758-bd4b-dfc923875c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7fbbc3e32444688bb95d69facc12b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:05Z,use_quota=True,user_id='996250f2835f4147b7427ffc40aa6695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3a273d-7356-4e40-b217-fd0248df8b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3a273d-7356-4e40-b217-fd0248df8b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5f4326-4d32-490c-bc9d-d888424fbbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5f4326-4d32-490c-bc9d-d888424fbbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ccada78-ac16-4758-bd4b-dfc923875c31', 'volume_name': 'volume-9ccada78-ac16-4758-bd4b-dfc923875c31', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b8bf78-0eeb-4f36-b447-4ca720fef8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b8bf78-0eeb-4f36-b447-4ca720fef8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51c2015-0c5c-47a8-a70b-c0776260e622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:04 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Volume 9ccada78-ac16-4758-bd4b-dfc923875c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ccada78-ac16-4758-bd4b-dfc923875c31', 'volume_size': 1}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:05 devstack sudo[92340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26
Sep 09 03:53:05 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:05 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26" returned: 0 in 0.241s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-1afa2c3e-a8fe-454d-9777-219d9d3218a7 req-8f17f1ed-c9b2-4594-9aba-34e2f5e69ea7 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.412s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9037ee0-2a8e-4a30-a159-314f34c5da6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87829d77-7b80-4a03-94cb-95d33ff3eb26', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86dc532-a018-4849-af2a-535fe40030f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-1afa2c3e-a8fe-454d-9777-219d9d3218a7 req-8f17f1ed-c9b2-4594-9aba-34e2f5e69ea7 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.307s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1978929131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccada78-ac16-4758-bd4b-dfc923875c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7fbbc3e32444688bb95d69facc12b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:05Z,use_quota=True,user_id='996250f2835f4147b7427ffc40aa6695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Creating volume 9ccada78-ac16-4758-bd4b-dfc923875c31 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:53:05 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9ccada78-ac16-4758-bd4b-dfc923875c31 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:05 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Volume volume-87829d77-7b80-4a03-94cb-95d33ff3eb26 (87829d77-7b80-4a03-94cb-95d33ff3eb26): created successfully
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86dc532-a018-4849-af2a-535fe40030f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:05 devstack sudo[92343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9ccada78-ac16-4758-bd4b-dfc923875c31 1073741824
Sep 09 03:53:05 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Flow 'volume_create_manager' (e53743d4-c687-44fe-9b14-a914ddb79b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:05 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4deba7fb-c69b-4b52-95e0-48d9b27fb2ce tempest-GroupSnapshotsTest-2146613640 None] Created volume successfully.
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-1afa2c3e-a8fe-454d-9777-219d9d3218a7 req-8f17f1ed-c9b2-4594-9aba-34e2f5e69ea7 tempest-ServerActionsTestOtherA-1293361095 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-a8f77a03-229c-4b74-80da-ea71a6add0e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2619b192-6ed7-4a8e-8da6-d010ec4d19a1', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 03:53:05 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-1afa2c3e-a8fe-454d-9777-219d9d3218a7 req-8f17f1ed-c9b2-4594-9aba-34e2f5e69ea7 tempest-ServerActionsTestOtherA-1293361095 None] attachment_update completed successfully.
Sep 09 03:53:05 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] GroupSnapshot cd8540d2-66d8-4fc0-9307-34d8ad2eac3c: creating.
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] Group snapshot cd8540d2-66d8-4fc0-9307-34d8ad2eac3c: creating. {{(pid=87558) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:05 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9ccada78-ac16-4758-bd4b-dfc923875c31 1073741824" returned: 0 in 0.603s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9ccada78-ac16-4758-bd4b-dfc923875c31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:05 devstack sudo[92351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9ccada78-ac16-4758-bd4b-dfc923875c31
Sep 09 03:53:05 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:06 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9ccada78-ac16-4758-bd4b-dfc923875c31" returned: 0 in 0.301s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:53:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.358s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51c2015-0c5c-47a8-a70b-c0776260e622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ccada78-ac16-4758-bd4b-dfc923875c31', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26069cc1-feec-4f38-86e5-249236d4f6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] Creating offline snapshot 3886c649-c65a-47ef-b97d-479e4df23a91 of volume 87829d77-7b80-4a03-94cb-95d33ff3eb26 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:53:06 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Volume volume-9ccada78-ac16-4758-bd4b-dfc923875c31 (9ccada78-ac16-4758-bd4b-dfc923875c31): created successfully
Sep 09 03:53:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26069cc1-feec-4f38-86e5-249236d4f6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Flow 'volume_create_manager' (afb7611d-d54c-4201-b593-fc69f78c7b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:06 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bf622b-a412-4283-80ca-74a73d5c3072]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:06 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e7f4f7c7-0782-4c41-8f8e-ce29f957751e tempest-VolumesMetadataTest-2006828136 None] Created volume successfully.
Sep 09 03:53:06 devstack sudo[92364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26
Sep 09 03:53:06 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:06 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26" returned: 0 in 0.442s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:06 devstack sudo[92441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91 1G
Sep 09 03:53:06 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "cinder-6df4c944-d9b5-4070-b9b1-bc0a34273743-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Lock "cinder-6df4c944-d9b5-4070-b9b1-bc0a34273743-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "cinder-quobyte-6df4c944-d9b5-4070-b9b1-bc0a34273743" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Lock "cinder-quobyte-6df4c944-d9b5-4070-b9b1-bc0a34273743" acquired by "delete_volume" :: waited 0.034s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:07 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfdcfa5-c52b-49a7-9022-424234fe69ad]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6df4c944-d9b5-4070-b9b1-bc0a34273743 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:07 devstack sudo[92482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6df4c944-d9b5-4070-b9b1-bc0a34273743
Sep 09 03:53:07 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:07 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91 1G" returned: 0 in 0.938s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87829d77-7b80-4a03-94cb-95d33ff3eb26 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:07 devstack sudo[92802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87829d77-7b80-4a03-94cb-95d33ff3eb26 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91
Sep 09 03:53:07 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:07 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6df4c944-d9b5-4070-b9b1-bc0a34273743" returned: 0 in 0.683s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6df4c944-d9b5-4070-b9b1-bc0a34273743 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:08 devstack sudo[92808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6df4c944-d9b5-4070-b9b1-bc0a34273743
Sep 09 03:53:08 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:08 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87829d77-7b80-4a03-94cb-95d33ff3eb26 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91" returned: 0 in 0.517s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:08 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91 is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:08 devstack sudo[92814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91
Sep 09 03:53:08 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:08 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6df4c944-d9b5-4070-b9b1-bc0a34273743" returned: 0 in 0.370s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Lock "cinder-quobyte-6df4c944-d9b5-4070-b9b1-bc0a34273743" released by "delete_volume" :: held 1.150s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Created reservations ['acd721fc-b79e-486a-ab66-68f7cf9f2d73', 'a96183bf-026c-4751-bcfb-a58daa9ee52d', 'b99a785f-a7b6-4af1-b1ac-70935ac77a9d', '48c131a9-831e-458e-b9d6-43f306396e37'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:08 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91" returned: 0 in 0.350s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:08 devstack sudo[92818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:53:08 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:08 devstack sudo[92819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.info
Sep 09 03:53:08 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Acquiring lock "cinder-9ccada78-ac16-4758-bd4b-dfc923875c31-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Lock "cinder-9ccada78-ac16-4758-bd4b-dfc923875c31-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Acquiring lock "cinder-quobyte-9ccada78-ac16-4758-bd4b-dfc923875c31" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Lock "cinder-quobyte-9ccada78-ac16-4758-bd4b-dfc923875c31" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a337ae-e185-478a-94b8-0ec3864dd247]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9ccada78-ac16-4758-bd4b-dfc923875c31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:08 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.375s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:08 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:53:09 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Deleted volume successfully.
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-687b97e5-1d1f-4a10-9aff-c77318695d6e tempest-AttachVolumeNegativeTest-1819164189 None] Lock "cinder-6df4c944-d9b5-4070-b9b1-bc0a34273743-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:09 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.info" returned: 0 in 0.437s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:09 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:09 devstack sudo[92827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.info
Sep 09 03:53:09 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:09 devstack sudo[92825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9ccada78-ac16-4758-bd4b-dfc923875c31
Sep 09 03:53:09 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:09 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.info" returned: 0 in 0.344s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.198s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:09 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-5e32c124-9943-4dd8-b1a6-7f8b1d3a39cd tempest-GroupSnapshotsTest-2146613640 None] group_snapshot cd8540d2-66d8-4fc0-9307-34d8ad2eac3c: created successfully
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "cinder-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "cinder-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:09 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9ccada78-ac16-4758-bd4b-dfc923875c31" returned: 0 in 0.693s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9ccada78-ac16-4758-bd4b-dfc923875c31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:09 devstack sudo[92835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9ccada78-ac16-4758-bd4b-dfc923875c31
Sep 09 03:53:09 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "cinder-quobyte-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "cinder-quobyte-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[54368d31-12a6-4000-9da4-79f1ee7ddc32]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:09 devstack sudo[92837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6
Sep 09 03:53:09 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:09 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9ccada78-ac16-4758-bd4b-dfc923875c31" returned: 0 in 0.335s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Lock "cinder-quobyte-9ccada78-ac16-4758-bd4b-dfc923875c31" released by "delete_volume" :: held 1.118s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Created reservations ['63042db0-0899-4513-a89d-4c9d8e8fc0b1', '8e1cc5c7-b80f-44c8-abc5-02cfe5d04c74', '31a0e685-dd26-4d1b-8fe2-12c7824df533', 'fb08ffc5-4271-4270-bfa4-1463a2ebbff9'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:10 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6" returned: 0 in 0.495s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:10 devstack sudo[92845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6
Sep 09 03:53:10 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:10 devstack sudo[92844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:53:10 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:10 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] group_snapshot cd8540d2-66d8-4fc0-9307-34d8ad2eac3c: deleting
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] group_snapshot cd8540d2-66d8-4fc0-9307-34d8ad2eac3c: deleting {{(pid=87558) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 09 03:53:10 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:10 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.518s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6" returned: 0 in 0.506s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-87829d77-7b80-4a03-94cb-95d33ff3eb26" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:10 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Deleted volume successfully.
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "cinder-quobyte-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6" released by "delete_volume" :: held 1.067s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-87829d77-7b80-4a03-94cb-95d33ff3eb26" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-3886c649-c65a-47ef-b97d-479e4df23a91" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7044ecb9-fd0a-471f-958d-c22d7cbed5c4 tempest-VolumesMetadataTest-2006828136 None] Lock "cinder-9ccada78-ac16-4758-bd4b-dfc923875c31-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-3886c649-c65a-47ef-b97d-479e4df23a91" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Deleting offline snapshot 3886c649-c65a-47ef-b97d-479e4df23a91 of volume 87829d77-7b80-4a03-94cb-95d33ff3eb26 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] snapshot_file for this snap is: volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[797a7fb9-3e7f-4b96-8771-999ca06e1e5d]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Created reservations ['19f9626e-f67a-4782-9315-a736f911a682', 'f7357580-f3e5-4f5e-98e3-3880fae49bb0', '7e382312-91b2-4539-aaf0-bd91062bd167', '767ab053-cb62-425c-b5f1-bc17279d2958'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:11 devstack sudo[92852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:53:11 devstack sudo[92851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91
Sep 09 03:53:11 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:11 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:11 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.304s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:11 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:53:11 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Deleted volume successfully.
Sep 09 03:53:11 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91" returned: 0 in 0.482s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87829d77-7b80-4a03-94cb-95d33ff3eb26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:53:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e02ac889-48bf-4cf2-92e8-85dc87e66115 tempest-AttachVolumeNegativeTest-1819164189 None] Lock "cinder-cdfe516d-ee19-47c0-817d-7b06a7d3dbf6-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:11 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[95de998c-96b4-44a8-8f64-2e763cd1b3de]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:11 devstack sudo[92859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26
Sep 09 03:53:11 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:11 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26" returned: 0 in 0.398s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:11 devstack sudo[92865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91
Sep 09 03:53:11 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "cinder-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Lock "cinder-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:12 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91" returned: 0 in 0.490s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "cinder-quobyte-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Lock "cinder-quobyte-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:12 devstack sudo[92871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91
Sep 09 03:53:12 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a9bcf8-7396-46e6-ad44-696357bc41a7]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:12 devstack sudo[92873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d
Sep 09 03:53:12 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:12 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26.3886c649-c65a-47ef-b97d-479e4df23a91" returned: 0 in 0.340s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-3886c649-c65a-47ef-b97d-479e4df23a91" released by "_delete_snapshot" :: held 1.837s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-87829d77-7b80-4a03-94cb-95d33ff3eb26" released by "delete_snapshot" :: held 1.882s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:12 devstack cinder-volume[87558]: WARNING cinder.quota [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1518532502 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1518532502, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:53:12 devstack cinder-volume[87558]: WARNING cinder.quota [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1518532502 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1518532502, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] Created reservations ['06b25abf-3928-44b5-81a0-e548d39e408a', '8d3a1acd-ccbc-449c-8de4-ed3791c0c798', '7ca20cee-7cc4-4d74-94ae-cfb31cbaa90f', 'b51e7927-4172-40bd-8311-26d190f8c376'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:12 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-132ec875-55e7-4d37-a6a2-f7c4093b50fd tempest-GroupSnapshotsTest-2146613640 None] group_snapshot cd8540d2-66d8-4fc0-9307-34d8ad2eac3c: deleted successfully
Sep 09 03:53:12 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d" returned: 0 in 0.485s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:12 devstack sudo[92880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d
Sep 09 03:53:12 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:13 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d" returned: 0 in 0.360s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Lock "cinder-quobyte-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d" released by "delete_volume" :: held 0.915s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Created reservations ['d723cd8c-88b6-4d78-b647-4b4652fe581f', 'bc60383c-c618-4d3d-a35e-0074c1777179', '1f1ec01a-9ac6-47c7-8f11-67c0afb5a31d', 'aca5e657-13c3-4d61-90b7-d922b5c1ef7a'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:13 devstack sudo[92883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:53:13 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "cinder-quobyte-87829d77-7b80-4a03-94cb-95d33ff3eb26" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-87829d77-7b80-4a03-94cb-95d33ff3eb26" acquired by "delete_volume" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[966c1202-7c1c-4fda-a597-9c5f119c9bc8]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:13 devstack sudo[92885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26
Sep 09 03:53:13 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:13 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.386s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:53:13 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Deleted volume successfully.
Sep 09 03:53:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-98b9041b-1c71-41bf-b4e7-35252093f91c tempest-AttachVolumeNegativeTest-1819164189 None] Lock "cinder-b8975fd5-2649-4e21-bf68-ee6fe0e0a29d-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:14 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26" returned: 0 in 0.435s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:14 devstack sudo[92892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26
Sep 09 03:53:14 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:14 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-87829d77-7b80-4a03-94cb-95d33ff3eb26" returned: 0 in 0.273s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Lock "cinder-quobyte-87829d77-7b80-4a03-94cb-95d33ff3eb26" released by "delete_volume" :: held 0.796s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Created reservations ['c63e43ec-10ae-4d85-b98b-3090b51fa611'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:14 devstack cinder-volume[87558]: WARNING cinder.quota [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1518532502 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1518532502, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Created reservations ['f1beb7ab-228a-427f-81bc-23c0abf69054', 'af52b76c-18c5-4f5c-b8e9-52491fd1b393', '96309b64-4037-47cb-9f2f-2304e46e78b2', 'b4dc40e9-03cc-41ad-8be8-b368a4d3d8a8'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:14 devstack sudo[92896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:53:14 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:14 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.305s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:14 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:53:14 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-490e178e-4e2b-4451-9a9f-8f95db15fd0f tempest-GroupSnapshotsTest-2146613640 None] Delete group completed successfully.
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Flow 'volume_create_manager' (1ad91338-127f-465c-9d85-36e2630c7bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2545d4b3-4e65-48f0-824e-6466664a0177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2545d4b3-4e65-48f0-824e-6466664a0177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1814779876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91bd770-323f-46a4-952b-d6137a874502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be403899a5804f8098cd7be1fb6a1dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:18Z,use_quota=True,user_id='bbd815a7336d43639e7764f09f599791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5d6075-8144-4e27-a283-da1106466144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5d6075-8144-4e27-a283-da1106466144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e70015-97bd-4c88-824f-c0963c1f567e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e70015-97bd-4c88-824f-c0963c1f567e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91bd770-323f-46a4-952b-d6137a874502', 'volume_name': 'volume-c91bd770-323f-46a4-952b-d6137a874502', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f733f6-2c71-4e4f-b202-aafef6884847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f733f6-2c71-4e4f-b202-aafef6884847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77672595-aeef-412e-b09e-721b6b96c3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:18 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Volume c91bd770-323f-46a4-952b-d6137a874502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91bd770-323f-46a4-952b-d6137a874502', 'volume_size': 1}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1814779876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91bd770-323f-46a4-952b-d6137a874502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be403899a5804f8098cd7be1fb6a1dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:18Z,use_quota=True,user_id='bbd815a7336d43639e7764f09f599791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Creating volume c91bd770-323f-46a4-952b-d6137a874502 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:53:18 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:53:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c91bd770-323f-46a4-952b-d6137a874502 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:18 devstack sudo[92900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c91bd770-323f-46a4-952b-d6137a874502 1073741824
Sep 09 03:53:18 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:19 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c91bd770-323f-46a4-952b-d6137a874502 1073741824" returned: 0 in 0.669s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c91bd770-323f-46a4-952b-d6137a874502 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:19 devstack sudo[92906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c91bd770-323f-46a4-952b-d6137a874502
Sep 09 03:53:19 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:19 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c91bd770-323f-46a4-952b-d6137a874502" returned: 0 in 0.306s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:53:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77672595-aeef-412e-b09e-721b6b96c3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91bd770-323f-46a4-952b-d6137a874502', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5548a775-ab66-4b9d-aad5-009f43519b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:19 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Volume volume-c91bd770-323f-46a4-952b-d6137a874502 (c91bd770-323f-46a4-952b-d6137a874502): created successfully
Sep 09 03:53:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5548a775-ab66-4b9d-aad5-009f43519b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Flow 'volume_create_manager' (1ad91338-127f-465c-9d85-36e2630c7bdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:19 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-07cb5cc5-9095-4f30-b92b-f5398e345ea9 tempest-VolumesTransfersV357Test-172708464 None] Created volume successfully.
Sep 09 03:53:22 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d7ed7956-d232-4e30-8cac-1b4c0d9ced66 tempest-VolumesTransfersV357Test-218129817 None] Transfer volume completed successfully.
Sep 09 03:53:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Acquiring lock "cinder-c91bd770-323f-46a4-952b-d6137a874502-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Lock "cinder-c91bd770-323f-46a4-952b-d6137a874502-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Acquiring lock "cinder-quobyte-c91bd770-323f-46a4-952b-d6137a874502" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Lock "cinder-quobyte-c91bd770-323f-46a4-952b-d6137a874502" acquired by "delete_volume" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:23 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dc2f39-f22a-46cb-9566-f0642b5bfa9b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c91bd770-323f-46a4-952b-d6137a874502 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:23 devstack sudo[92939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c91bd770-323f-46a4-952b-d6137a874502
Sep 09 03:53:23 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:23 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c91bd770-323f-46a4-952b-d6137a874502" returned: 0 in 0.394s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c91bd770-323f-46a4-952b-d6137a874502 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:23 devstack sudo[92944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c91bd770-323f-46a4-952b-d6137a874502
Sep 09 03:53:23 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:23 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c91bd770-323f-46a4-952b-d6137a874502" returned: 0 in 0.279s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Lock "cinder-quobyte-c91bd770-323f-46a4-952b-d6137a874502" released by "delete_volume" :: held 0.728s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:23 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Created reservations ['bf40aeff-3276-46a0-b629-a6a5079d3894', '2f30a768-c8a6-431d-9cdc-83a394d649b7', 'fb76cf1b-9d54-4aa3-9412-b3a9da900f03', '1da9e4db-c73d-4bf2-9ca9-7ef60f8ca6bd'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:24 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4ca94f34-2bc1-4edd-8289-1ebcacf3de4f tempest-GroupSnapshotsV319Test-1787788892 None] Group tempest-GroupSnapshotsV319Test-Group-1626295684: creating
Sep 09 03:53:24 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4ca94f34-2bc1-4edd-8289-1ebcacf3de4f tempest-GroupSnapshotsV319Test-1787788892 None] Group tempest-GroupSnapshotsV319Test-Group-1626295684: created successfully
Sep 09 03:53:24 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4ca94f34-2bc1-4edd-8289-1ebcacf3de4f tempest-GroupSnapshotsV319Test-1787788892 None] Create group completed successfully.
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:24 devstack sudo[92947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:53:24 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:24 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.291s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:53:24 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Deleted volume successfully.
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1cce36e8-249a-43af-8301-1ed47dbb2a51 tempest-VolumesTransfersV357Test-1992445367 None] Lock "cinder-c91bd770-323f-46a4-952b-d6137a874502-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Flow 'volume_create_manager' (f9cba664-ad4b-40ad-bd0a-f97c7cecf26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec7524f-0d84-4448-8790-9423f6cb3c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec7524f-0d84-4448-8790-9423f6cb3c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1742425440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a039d71-fa57-423c-85a3-1995925040b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be403899a5804f8098cd7be1fb6a1dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:25Z,use_quota=True,user_id='bbd815a7336d43639e7764f09f599791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab8271b-543c-49aa-96f3-363e39601db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab8271b-543c-49aa-96f3-363e39601db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3873a6-7f13-49c9-b8db-977b18682a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3873a6-7f13-49c9-b8db-977b18682a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a039d71-fa57-423c-85a3-1995925040b9', 'volume_name': 'volume-8a039d71-fa57-423c-85a3-1995925040b9', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5baee179-d6fb-4f3e-8376-a89a68990f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5baee179-d6fb-4f3e-8376-a89a68990f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d09dc7e-cdbf-440d-ac79-f258ec4d302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:24 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Volume 8a039d71-fa57-423c-85a3-1995925040b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a039d71-fa57-423c-85a3-1995925040b9', 'volume_size': 1}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1742425440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a039d71-fa57-423c-85a3-1995925040b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be403899a5804f8098cd7be1fb6a1dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:25Z,use_quota=True,user_id='bbd815a7336d43639e7764f09f599791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Creating volume 8a039d71-fa57-423c-85a3-1995925040b9 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:53:24 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:53:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8a039d71-fa57-423c-85a3-1995925040b9 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:24 devstack sudo[92951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8a039d71-fa57-423c-85a3-1995925040b9 1073741824
Sep 09 03:53:24 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d89998fb-1ba9-4882-8f76-674a449a2b31 tempest-GroupsV314Test-1866070560 None] Group tempest-GroupsV314Test-Group-2014082222: creating
Sep 09 03:53:25 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d89998fb-1ba9-4882-8f76-674a449a2b31 tempest-GroupsV314Test-1866070560 None] Group tempest-GroupsV314Test-Group-2014082222: created successfully
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8a039d71-fa57-423c-85a3-1995925040b9 1073741824" returned: 0 in 0.522s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d89998fb-1ba9-4882-8f76-674a449a2b31 tempest-GroupsV314Test-1866070560 None] Create group completed successfully.
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8a039d71-fa57-423c-85a3-1995925040b9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:25 devstack sudo[92957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8a039d71-fa57-423c-85a3-1995925040b9
Sep 09 03:53:25 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Flow 'volume_create_manager' (3fd30bef-729f-426a-b40e-87315882346d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d81c432-e7a1-4dbf-8105-39b27d1e4f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d81c432-e7a1-4dbf-8105-39b27d1e4f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-424020512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bfd6fd7e-3a3e-4883-b8c1-2c3411e0e94e,host='devstack@QuobyteHD#QuobyteHD',id=1a581bb5-0535-498c-a60c-48fc665253b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d100a69d3b3b42d492b18493b9912378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:26Z,use_quota=True,user_id='8fdc8a657ac24df2b35f899bfd2e7bb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1bb4c1-da60-4f65-91cb-03b03b6598e0),volume_type_id=ef1bb4c1-da60-4f65-91cb-03b03b6598e0)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5f2476-c8c7-4a9e-8ec0-8c23c6a19ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5f2476-c8c7-4a9e-8ec0-8c23c6a19ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed63d940-2b27-41ac-857e-65d0c47edc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed63d940-2b27-41ac-857e-65d0c47edc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a581bb5-0535-498c-a60c-48fc665253b7', 'volume_name': 'volume-1a581bb5-0535-498c-a60c-48fc665253b7', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27546423-dbdf-47c7-acdb-a826952736af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27546423-dbdf-47c7-acdb-a826952736af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a0034f-13b6-4bd7-9ec9-641aad46c5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:25 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Volume 1a581bb5-0535-498c-a60c-48fc665253b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a581bb5-0535-498c-a60c-48fc665253b7', 'volume_size': 1}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:25 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8a039d71-fa57-423c-85a3-1995925040b9" returned: 0 in 0.271s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bfd6fd7e-3a3e-4883-b8c1-2c3411e0e94e,created_at=2026-09-09T01:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-424020512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bfd6fd7e-3a3e-4883-b8c1-2c3411e0e94e,host='devstack@QuobyteHD#QuobyteHD',id=1a581bb5-0535-498c-a60c-48fc665253b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d100a69d3b3b42d492b18493b9912378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:26Z,use_quota=True,user_id='8fdc8a657ac24df2b35f899bfd2e7bb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1bb4c1-da60-4f65-91cb-03b03b6598e0),volume_type_id=ef1bb4c1-da60-4f65-91cb-03b03b6598e0)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Creating volume 1a581bb5-0535-498c-a60c-48fc665253b7 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:53:25 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d09dc7e-cdbf-440d-ac79-f258ec4d302c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a039d71-fa57-423c-85a3-1995925040b9', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:25 devstack sudo[92960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7 1073741824
Sep 09 03:53:25 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a8dc50-a557-46b0-a2bb-71534fad7a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:25 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Volume volume-8a039d71-fa57-423c-85a3-1995925040b9 (8a039d71-fa57-423c-85a3-1995925040b9): created successfully
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a8dc50-a557-46b0-a2bb-71534fad7a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Flow 'volume_create_manager' (f9cba664-ad4b-40ad-bd0a-f97c7cecf26f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ddae83c6-8ab0-443c-afae-6261ecc1e7a3 tempest-VolumesTransfersV357Test-172708464 None] Created volume successfully.
Sep 09 03:53:26 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7 1073741824" returned: 0 in 0.412s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:26 devstack sudo[92966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7
Sep 09 03:53:26 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:26 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7" returned: 0 in 0.252s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a0034f-13b6-4bd7-9ec9-641aad46c5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a581bb5-0535-498c-a60c-48fc665253b7', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c657eb99-cb9c-4369-8e93-3188b9652bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:26 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Volume volume-1a581bb5-0535-498c-a60c-48fc665253b7 (1a581bb5-0535-498c-a60c-48fc665253b7): created successfully
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c657eb99-cb9c-4369-8e93-3188b9652bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Flow 'volume_create_manager' (3fd30bef-729f-426a-b40e-87315882346d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:26 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2f02606a-6111-4bb4-86c1-906afebe2c88 tempest-GroupSnapshotsV319Test-1787788892 None] Created volume successfully.
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:27 devstack sudo[92993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:53:27 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Flow 'volume_create_manager' (3f0275c0-dfb3-473d-80e8-47db38482f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5e0bf8-d3d0-4f7e-a5e6-29fe8b68c396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5e0bf8-d3d0-4f7e-a5e6-29fe8b68c396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-594180527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7eeb7401-e83a-4f0b-8844-edb2124027cd,host='devstack@QuobyteHD#QuobyteHD',id=3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2770de6ace824d8595f6db4951a49062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:27Z,use_quota=True,user_id='2d0ac829b01347edb75f44cedc21d237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48b0ded4-0dfb-47f6-a5a6-23b5ddd88f1e),volume_type_id=48b0ded4-0dfb-47f6-a5a6-23b5ddd88f1e)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aaa61c2-393b-4cdb-819c-66e4d4ecff8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aaa61c2-393b-4cdb-819c-66e4d4ecff8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6d60c3-13f5-417d-8bf4-33048e537508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6d60c3-13f5-417d-8bf4-33048e537508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b', 'volume_name': 'volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605dc367-d87c-4834-a027-792a35af91bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605dc367-d87c-4834-a027-792a35af91bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8dbd62-51e6-4736-86a4-5b87d925b041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:27 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Volume 3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b', 'volume_size': 1}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7eeb7401-e83a-4f0b-8844-edb2124027cd,created_at=2026-09-09T01:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-594180527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7eeb7401-e83a-4f0b-8844-edb2124027cd,host='devstack@QuobyteHD#QuobyteHD',id=3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2770de6ace824d8595f6db4951a49062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:27Z,use_quota=True,user_id='2d0ac829b01347edb75f44cedc21d237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48b0ded4-0dfb-47f6-a5a6-23b5ddd88f1e),volume_type_id=48b0ded4-0dfb-47f6-a5a6-23b5ddd88f1e)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Creating volume 3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:53:27 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:27 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] GroupSnapshot 0244efd8-dd54-404b-b7ff-161bfb04ede1: creating.
Sep 09 03:53:27 devstack sudo[92995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b 1073741824
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] Group snapshot 0244efd8-dd54-404b-b7ff-161bfb04ede1: creating. {{(pid=87558) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 09 03:53:27 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:27 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.362s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 9 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Acquiring lock "cinder-8a039d71-fa57-423c-85a3-1995925040b9-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Lock "cinder-8a039d71-fa57-423c-85a3-1995925040b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Acquiring lock "cinder-quobyte-8a039d71-fa57-423c-85a3-1995925040b9" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Lock "cinder-quobyte-8a039d71-fa57-423c-85a3-1995925040b9" acquired by "delete_volume" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbba905-33e5-47e9-a637-6b5d51a93a19]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8a039d71-fa57-423c-85a3-1995925040b9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:27 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b 1073741824" returned: 0 in 0.488s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:27 devstack sudo[93001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8a039d71-fa57-423c-85a3-1995925040b9
Sep 09 03:53:27 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:27 devstack sudo[93004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b
Sep 09 03:53:27 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:27 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8a039d71-fa57-423c-85a3-1995925040b9" returned: 0 in 0.370s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8a039d71-fa57-423c-85a3-1995925040b9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:27 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b" returned: 0 in 0.245s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.715s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:27 devstack sudo[93010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8a039d71-fa57-423c-85a3-1995925040b9
Sep 09 03:53:27 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8dbd62-51e6-4736-86a4-5b87d925b041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea0114a-76c9-4273-bc08-d37411c97470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] Creating offline snapshot 669b4d49-4aac-4c32-9f46-ca05600a7b2f of volume 1a581bb5-0535-498c-a60c-48fc665253b7 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:53:28 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Volume volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b (3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b): created successfully
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea0114a-76c9-4273-bc08-d37411c97470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Flow 'volume_create_manager' (3f0275c0-dfb3-473d-80e8-47db38482f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b67bed-7213-4fb4-94e9-5789f4b81cf1]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:28 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-696e6ab8-a0a3-47d7-ba9c-52c2f9853f96 tempest-GroupsV314Test-1866070560 None] Created volume successfully.
Sep 09 03:53:28 devstack sudo[93012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7
Sep 09 03:53:28 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:28 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8a039d71-fa57-423c-85a3-1995925040b9" returned: 0 in 0.255s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Lock "cinder-quobyte-8a039d71-fa57-423c-85a3-1995925040b9" released by "delete_volume" :: held 0.669s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Created reservations ['cc7ce34a-295f-488e-929a-a2d053ba934d', 'cf023e07-7622-4e99-87e9-77287164b8ec', 'bed5d21e-5637-41f2-b55f-10867ca69578', 'a35411e7-64a9-4e79-aac2-c67f2bbdf05c'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:28 devstack sudo[93018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:53:28 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:28 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7" returned: 0 in 0.437s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:28 devstack sudo[93020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f 1G
Sep 09 03:53:28 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:28 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.294s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:53:28 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Deleted volume successfully.
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27731b2b-f5c9-4256-baaa-cd4aae1b5b85 tempest-VolumesTransfersV357Test-1992445367 None] Lock "cinder-8a039d71-fa57-423c-85a3-1995925040b9-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:28 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f 1G" returned: 0 in 0.493s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a581bb5-0535-498c-a60c-48fc665253b7 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:28 devstack sudo[93026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a581bb5-0535-498c-a60c-48fc665253b7 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f
Sep 09 03:53:28 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:29 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a581bb5-0535-498c-a60c-48fc665253b7 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f" returned: 0 in 0.357s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:29 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:53:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:29 devstack sudo[93032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f
Sep 09 03:53:29 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:29 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f" returned: 0 in 0.288s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:29 devstack sudo[93035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.info
Sep 09 03:53:29 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:29 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.info" returned: 0 in 0.305s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:29 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:53:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:29 devstack sudo[93038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.info
Sep 09 03:53:29 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:30 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.info" returned: 0 in 0.268s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.138s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:30 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Cloning volume 3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b to volume 57961798-9bd2-4721-a780-2906c7eb7316
Sep 09 03:53:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Creating offline snapshot 1d9291ba-92dc-4a77-8f06-80c97ab04729 of volume 3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:53:30 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0883b48c-dcab-4fb0-bbbf-1c27caf58e30]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-90d4c39c-d2b9-4cd4-a3de-bd2a1bea3475 tempest-GroupSnapshotsV319Test-1787788892 None] group_snapshot 0244efd8-dd54-404b-b7ff-161bfb04ede1: created successfully
Sep 09 03:53:30 devstack sudo[93041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b
Sep 09 03:53:30 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:30 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b" returned: 0 in 0.612s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:30 devstack sudo[93046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729 1G
Sep 09 03:53:30 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:31 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] group_snapshot 0244efd8-dd54-404b-b7ff-161bfb04ede1: deleting
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] group_snapshot 0244efd8-dd54-404b-b7ff-161bfb04ede1: deleting {{(pid=87558) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Acquiring lock "cinder-quobyte-1a581bb5-0535-498c-a60c-48fc665253b7" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Lock "cinder-quobyte-1a581bb5-0535-498c-a60c-48fc665253b7" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Acquiring lock "cinder-quobyte-669b4d49-4aac-4c32-9f46-ca05600a7b2f" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Lock "cinder-quobyte-669b4d49-4aac-4c32-9f46-ca05600a7b2f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Deleting offline snapshot 669b4d49-4aac-4c32-9f46-ca05600a7b2f of volume 1a581bb5-0535-498c-a60c-48fc665253b7 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] snapshot_file for this snap is: volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4418d2fa-e0f2-489b-b593-1fcd4fc0a452]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:31 devstack sudo[93050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f
Sep 09 03:53:31 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:31 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729 1G" returned: 0 in 0.670s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:31 devstack sudo[93054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729
Sep 09 03:53:31 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:31 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f" returned: 0 in 0.529s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a581bb5-0535-498c-a60c-48fc665253b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94669a1-490f-42ba-b49b-9bdc54ed7539]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:32 devstack sudo[93059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7
Sep 09 03:53:32 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:32 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729" returned: 0 in 0.495s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:32 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729 is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:53:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:32 devstack sudo[93065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729
Sep 09 03:53:32 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:32 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7" returned: 0 in 0.419s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:32 devstack sudo[93070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f
Sep 09 03:53:32 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:32 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729" returned: 0 in 0.327s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:32 devstack sudo[93073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.info
Sep 09 03:53:32 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:32 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f" returned: 0 in 0.366s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:32 devstack sudo[93078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f
Sep 09 03:53:32 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:32 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.info" returned: 0 in 0.292s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:32 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:53:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:32 devstack sudo[93081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.info
Sep 09 03:53:32 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:33 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7.669b4d49-4aac-4c32-9f46-ca05600a7b2f" returned: 0 in 0.322s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:33 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.info" returned: 0 in 0.307s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Acquiring lock "cinder-quobyte-57961798-9bd2-4721-a780-2906c7eb7316" by "_copy_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Lock "cinder-quobyte-669b4d49-4aac-4c32-9f46-ca05600a7b2f" released by "_delete_snapshot" :: held 1.839s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Lock "cinder-quobyte-1a581bb5-0535-498c-a60c-48fc665253b7" released by "delete_snapshot" :: held 1.870s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Lock "cinder-quobyte-57961798-9bd2-4721-a780-2906c7eb7316" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] snapshot: 1d9291ba-92dc-4a77-8f06-80c97ab04729, volume: 57961798-9bd2-4721-a780-2906c7eb7316,  {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ccc72b-5bfc-4d1f-a0ee-5d695b81af31]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:33 devstack cinder-volume[87558]: WARNING cinder.quota [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-407290781 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-407290781, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:53:33 devstack cinder-volume[87558]: WARNING cinder.quota [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-407290781 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-407290781, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] Created reservations ['5fc832c2-d4ac-461c-b02e-2fcae5e729fe', 'aed2e767-1c8f-4244-be94-aead05735df5', '16adb6f6-933d-4b5e-924e-44721e5612e7', '7e9b9b04-3f7d-4a3a-8ff2-da26338efa13'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:33 devstack sudo[93087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729
Sep 09 03:53:33 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:33 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3c640ece-8e23-475b-8e33-da7e7a1516ef tempest-GroupSnapshotsV319Test-1787788892 None] group_snapshot 0244efd8-dd54-404b-b7ff-161bfb04ede1: deleted successfully
Sep 09 03:53:33 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729" returned: 0 in 0.478s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71ee533-810d-40ff-9ebd-068c03b9f10f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Acquiring lock "cinder-quobyte-1a581bb5-0535-498c-a60c-48fc665253b7" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:33 devstack sudo[93093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b
Sep 09 03:53:33 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Lock "cinder-quobyte-1a581bb5-0535-498c-a60c-48fc665253b7" acquired by "delete_volume" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:34 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d7685d-87a3-4e6e-85d2-db0c6caa9970]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:34 devstack sudo[93096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7
Sep 09 03:53:34 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b" returned: 0 in 0.605s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 03:53:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Creating direct copy from snapshot {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 03:53:34 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:34 devstack cinder-volume[87558]: DEBUG cinder.utils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Path /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316 not found in is_blk_device check {{(pid=87558) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 03:53:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:34 devstack sudo[93101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316
Sep 09 03:53:34 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:34 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-f66797ca-9595-4487-bdfb-30d1c20a2f8c req-8094d11c-5668-49ab-846b-9b9acf947029 tempest-ServerActionsTestOtherA-1293361095 None] Terminate volume connection completed successfully.
Sep 09 03:53:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-f66797ca-9595-4487-bdfb-30d1c20a2f8c req-8094d11c-5668-49ab-846b-9b9acf947029 tempest-ServerActionsTestOtherA-1293361095 None] Deleting attachment 2619b192-6ed7-4a8e-8da6-d010ec4d19a1. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 03:53:34 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7" returned: 0 in 0.570s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:34 devstack sudo[93112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7
Sep 09 03:53:34 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:34 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1a581bb5-0535-498c-a60c-48fc665253b7" returned: 0 in 0.296s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Lock "cinder-quobyte-1a581bb5-0535-498c-a60c-48fc665253b7" released by "delete_volume" :: held 1.006s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:35 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Created reservations ['60ff08df-a932-4fde-84b1-d72c2d64febb'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:35 devstack cinder-volume[87558]: WARNING cinder.quota [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-407290781 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-407290781, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:53:35 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Created reservations ['c1ed2c3e-8966-4b42-ae1e-f1feba05e36e', '26250391-a7ef-45ac-9055-f4f54a234a31', 'e040a822-750f-4bc9-b203-e677a9e6b9b5', '5d536b37-9b36-4005-af20-c77e75536123'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:35 devstack sudo[93126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:53:35 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:36 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.682s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:36 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:53:36 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e5277222-1125-4b27-bdb9-fdea978e7105 tempest-GroupSnapshotsV319Test-1787788892 None] Delete group completed successfully.
Sep 09 03:53:40 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316" returned: 0 in 6.362s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:40 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316 {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 03:53:40 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Converted 1024.00 MB image at 160.94 MB/s
Sep 09 03:53:40 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316 is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 03:53:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:40 devstack sudo[93157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316
Sep 09 03:53:40 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:41 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316" returned: 0 in 0.362s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Lock "cinder-quobyte-57961798-9bd2-4721-a780-2906c7eb7316" released by "_copy_volume_from_snapshot" :: held 7.927s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Acquiring lock "cinder-quobyte-1d9291ba-92dc-4a77-8f06-80c97ab04729" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Lock "cinder-quobyte-1d9291ba-92dc-4a77-8f06-80c97ab04729" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Deleting offline snapshot 1d9291ba-92dc-4a77-8f06-80c97ab04729 of volume 3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:53:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] snapshot_file for this snap is: volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:53:41 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e170a064-115a-4948-8d78-cd85f884eeaa]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:41 devstack sudo[93161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729
Sep 09 03:53:41 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:41 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729" returned: 0 in 0.538s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:53:41 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d081733-dc34-4a37-9615-ff7ac4037eae]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:41 devstack sudo[93166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b
Sep 09 03:53:41 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:42 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b" returned: 0 in 0.576s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:42 devstack sudo[93172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729
Sep 09 03:53:42 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:42 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729" returned: 0 in 0.480s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:42 devstack sudo[93178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729
Sep 09 03:53:42 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:43 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b.1d9291ba-92dc-4a77-8f06-80c97ab04729" returned: 0 in 0.306s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Lock "cinder-quobyte-1d9291ba-92dc-4a77-8f06-80c97ab04729" released by "_delete_snapshot" :: held 2.046s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.938s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:43 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3e3feac0-91ec-45a3-9e64-3f49caf23218 tempest-GroupsV314Test-1866070560 None] Create group from source-group-7eeb7401-e83a-4f0b-8844-edb2124027cd completed successfully.
Sep 09 03:53:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Acquiring lock "cinder-quobyte-57961798-9bd2-4721-a780-2906c7eb7316" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Lock "cinder-quobyte-57961798-9bd2-4721-a780-2906c7eb7316" acquired by "delete_volume" :: waited 0.055s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:44 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6509dd-a37e-44cc-b242-859b2e46df4f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:45 devstack sudo[93187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316
Sep 09 03:53:45 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:45 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316" returned: 0 in 0.568s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:45 devstack sudo[93195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316
Sep 09 03:53:45 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:45 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57961798-9bd2-4721-a780-2906c7eb7316" returned: 0 in 0.359s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Lock "cinder-quobyte-57961798-9bd2-4721-a780-2906c7eb7316" released by "delete_volume" :: held 1.036s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:45 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Created reservations ['544e597f-44f9-4a61-a956-5cb9c69a58d6'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:46 devstack cinder-volume[87558]: WARNING cinder.quota [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1248336059 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1248336059, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:53:46 devstack cinder-volume[87558]: WARNING cinder.quota [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1248336059 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1248336059, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Created reservations ['b1d8a856-39e3-49f6-a199-1436478adac2', '081774fa-082b-4ec6-9921-e8e68676784c', '3f8f9a2b-e054-44b1-90b5-03eaa25d5715', '66e9d96f-6c62-44e6-990a-9136f3caef77'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Flow 'volume_create_manager' (396c85ff-54b7-4e7d-bc59-d4f18312924f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3206ca62-05de-47d0-bae3-d9c6a02d2c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3206ca62-05de-47d0-bae3-d9c6a02d2c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-722694101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621bf9ec-ad59-4457-a283-ab0c9cb41133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ac2d1341304a888cebd2b490ee83c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:46Z,use_quota=True,user_id='6daa749fbe2d43afbac071140415829f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef4b275-bef3-4bb0-8514-6dc0b5e20132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef4b275-bef3-4bb0-8514-6dc0b5e20132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ef3de4-7ea3-4a76-bfeb-bdfa3f89ad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG cinder.image.glance [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Creating Keystone auth plugin from conf {{(pid=87558) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:46 devstack sudo[93198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:53:46 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:46 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.266s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:46 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:53:46 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-39b56189-4d5a-4f9c-a1bc-a909a6c85175 tempest-GroupsV314Test-1866070560 None] Delete group completed successfully.
Sep 09 03:53:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ef3de4-7ea3-4a76-bfeb-bdfa3f89ad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '621bf9ec-ad59-4457-a283-ab0c9cb41133', 'volume_name': 'volume-621bf9ec-ad59-4457-a283-ab0c9cb41133', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c0242d20>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0114b50c-c9f5-449b-b2ed-c4a8599e3ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0114b50c-c9f5-449b-b2ed-c4a8599e3ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb4e18a-ae85-4493-b942-74eba6aa81fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:47 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Volume 621bf9ec-ad59-4457-a283-ab0c9cb41133: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-621bf9ec-ad59-4457-a283-ab0c9cb41133', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c0242d20>}
Sep 09 03:53:47 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Trying to clone 621bf9ec-ad59-4457-a283-ab0c9cb41133 from image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]). {{(pid=87558) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 03:53:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Acquiring lock "cinder-quobyte-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:53:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Lock "cinder-quobyte-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b" acquired by "delete_volume" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:53:47 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 03:53:47 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Image download 20.69 MB at 20.69 MB/s
Sep 09 03:53:47 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfa1826-1c81-4e11-ac85-c1f4f9529e74]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:47 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4bffc1-0cdd-43a8-bc64-3177beef2ae9]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:47 devstack sudo[93222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b
Sep 09 03:53:47 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:48 devstack sudo[93223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD
Sep 09 03:53:48 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:48 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b" returned: 0 in 0.581s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:48 devstack sudo[93229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b
Sep 09 03:53:48 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:48 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD" returned: 0 in 0.563s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:48 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Temporary image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 is fetched for user 6daa749fbe2d43afbac071140415829f. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 03:53:48 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd45ae6-a001-47e0-8f27-f4636def118c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:48 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b" returned: 0 in 0.388s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:48 devstack sudo[93235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD
Sep 09 03:53:48 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Lock "cinder-quobyte-3c5a3f5f-1ebe-482b-b0dd-506ae0ca176b" released by "delete_volume" :: held 1.101s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:53:48 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Created reservations ['bf275d02-6439-431d-9d6c-bdf060dfd578'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Created reservations ['9e41ca75-0b6f-45c2-94ce-21b63cf89088', '4f4a81ab-08cc-495c-ba52-b7010b7e0854', 'f768981c-e3eb-4cab-8383-3023f4c5d084', 'c6072dc6-d976-42a7-b3ba-7df25d5a72cb'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:53:49 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-722694101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621bf9ec-ad59-4457-a283-ab0c9cb41133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ac2d1341304a888cebd2b490ee83c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:46Z,use_quota=True,user_id='6daa749fbe2d43afbac071140415829f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Creating volume 621bf9ec-ad59-4457-a283-ab0c9cb41133 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:53:49 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:49 devstack sudo[93241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133 1073741824
Sep 09 03:53:49 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:49 devstack sudo[93243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:53:49 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:49 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.464s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:53:49 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-014c4e74-8fbf-4015-be7f-dee088b45062 tempest-GroupsV314Test-1866070560 None] Delete group completed successfully.
Sep 09 03:53:49 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133 1073741824" returned: 0 in 0.717s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:49 devstack sudo[93251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133
Sep 09 03:53:49 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:50 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133" returned: 0 in 0.306s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:53:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:50 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Attempting download of 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}])) to volume 621bf9ec-ad59-4457-a283-ab0c9cb41133. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 03:53:50 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a0176f-3061-42f2-809e-d9dbfe6f7053]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_594dtep0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:50 devstack sudo[93254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_594dtep0
Sep 09 03:53:50 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:50 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_594dtep0" returned: 0 in 0.438s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_594dtep0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:50 devstack sudo[93258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_594dtep0
Sep 09 03:53:50 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:51 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_594dtep0" returned: 1 in 0.384s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_594dtep0' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 03:53:51 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[098588e2-3d65-4fc0-9adc-175b80ff6671]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:53:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:51 devstack sudo[93262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD
Sep 09 03:53:51 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:51 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:51 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 was qcow2, converting to qcow2 {{(pid=87558) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 03:53:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:51 devstack sudo[93267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133
Sep 09 03:53:51 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:54 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133" returned: 0 in 2.487s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:54 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qawtr4kldevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133 {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 03:53:54 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Converted 112.00 MB image at 45.01 MB/s
Sep 09 03:53:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:53:54 devstack sudo[93275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133 1G
Sep 09 03:53:54 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:53:54 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root
Sep 09 03:53:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133 1G" returned: 0 in 0.436s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:53:54 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Downloaded image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}])) to volume 621bf9ec-ad59-4457-a283-ab0c9cb41133 successfully. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 03:53:54 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Temporary image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 for user 6daa749fbe2d43afbac071140415829f is deleted. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 03:53:54 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Marking volume 621bf9ec-ad59-4457-a283-ab0c9cb41133 as bootable. {{(pid=87558) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 03:53:54 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Copying metadata from image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 to 621bf9ec-ad59-4457-a283-ab0c9cb41133. {{(pid=87558) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 03:53:54 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Creating volume glance metadata for volume 621bf9ec-ad59-4457-a283-ab0c9cb41133 backed by image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87558) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 03:53:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb4e18a-ae85-4493-b942-74eba6aa81fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621bf9ec-ad59-4457-a283-ab0c9cb41133', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c0242d20>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fade9792-8ec7-4024-8730-9bbb40db4c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:53:54 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Volume volume-621bf9ec-ad59-4457-a283-ab0c9cb41133 (621bf9ec-ad59-4457-a283-ab0c9cb41133): created successfully
Sep 09 03:53:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fade9792-8ec7-4024-8730-9bbb40db4c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:53:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Flow 'volume_create_manager' (396c85ff-54b7-4e7d-bc59-d4f18312924f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:53:54 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-5e8a12c7-dcec-4409-9872-ab1e5286f75b tempest-ServerActionsTestOtherA-1293361095 None] Created volume successfully.
Sep 09 03:53:59 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=152,cinder:UPDATE=178,cinder:INSERT=42,cinder:DELETE=8 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:53:59 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=175,cinder:SELECT=184,cinder:INSERT=53,cinder:DELETE=6 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:53:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-b3792659-f081-4c2c-ba33-f6f6db9102c0 req-16eb8f71-3e0b-4b96-bcdd-de20ef63c506 tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:53:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-b3792659-f081-4c2c-ba33-f6f6db9102c0 req-16eb8f71-3e0b-4b96-bcdd-de20ef63c506 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:53:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-b3792659-f081-4c2c-ba33-f6f6db9102c0 req-16eb8f71-3e0b-4b96-bcdd-de20ef63c506 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:53:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-b3792659-f081-4c2c-ba33-f6f6db9102c0 req-16eb8f71-3e0b-4b96-bcdd-de20ef63c506 tempest-ServerActionsTestOtherA-1293361095 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-621bf9ec-ad59-4457-a283-ab0c9cb41133', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a19b4d8f-cb76-4f55-85cf-adf1df5aa466', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 03:53:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-b3792659-f081-4c2c-ba33-f6f6db9102c0 req-16eb8f71-3e0b-4b96-bcdd-de20ef63c506 tempest-ServerActionsTestOtherA-1293361095 None] attachment_update completed successfully.
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Flow 'volume_create_manager' (654950a0-6693-4dde-a526-13fd0a4a6d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cdd9ab-9aa4-4a63-859a-8c07825cfd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cdd9ab-9aa4-4a63-859a-8c07825cfd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1545871309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989a1a35-bc4d-4d0f-b2f8-63b96944880c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa196ebe1324d9bbb826582ee00f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:01Z,use_quota=True,user_id='f496e92373c9415a97745ad602a5d39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a2953b-4505-48f2-ba56-66b39fcf9c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a2953b-4505-48f2-ba56-66b39fcf9c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f61b80d-4247-4f11-8ba4-6c100328fca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f61b80d-4247-4f11-8ba4-6c100328fca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '989a1a35-bc4d-4d0f-b2f8-63b96944880c', 'volume_name': 'volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41cba5ba-a816-4081-8abc-2e227990ae28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41cba5ba-a816-4081-8abc-2e227990ae28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecb30c4-c1d6-4f81-9aed-addbab5d6479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:00 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Volume 989a1a35-bc4d-4d0f-b2f8-63b96944880c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c', 'volume_size': 1}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1545871309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989a1a35-bc4d-4d0f-b2f8-63b96944880c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa196ebe1324d9bbb826582ee00f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:01Z,use_quota=True,user_id='f496e92373c9415a97745ad602a5d39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Creating volume 989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:54:00 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:54:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:00 devstack sudo[93331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c 1073741824
Sep 09 03:54:00 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:01 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c 1073741824" returned: 0 in 0.531s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:01 devstack sudo[93337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c
Sep 09 03:54:01 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:01 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c" returned: 0 in 0.283s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:54:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecb30c4-c1d6-4f81-9aed-addbab5d6479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69dc5cd7-7196-4fc7-a95a-6ce4c0d35716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:01 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Volume volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c (989a1a35-bc4d-4d0f-b2f8-63b96944880c): created successfully
Sep 09 03:54:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69dc5cd7-7196-4fc7-a95a-6ce4c0d35716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Flow 'volume_create_manager' (654950a0-6693-4dde-a526-13fd0a4a6d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:54:01 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e2aa2d2f-2df8-431f-8f61-61571caee47d tempest-SnapshotsActionsTest-870936567 None] Created volume successfully.
Sep 09 03:54:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] Creating offline snapshot 370e419d-2197-4db1-8ca3-af146f71b7cb of volume 989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:54:03 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[450fb8c5-010d-4a5f-923e-1295dcd0efa5]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:03 devstack sudo[93343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c
Sep 09 03:54:03 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:03 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c" returned: 0 in 0.446s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:03 devstack sudo[93349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb 1G
Sep 09 03:54:03 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:04 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb 1G" returned: 0 in 0.580s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:04 devstack sudo[93355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb
Sep 09 03:54:04 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:04 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb" returned: 0 in 0.397s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:04 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb is being set with open permissions: ugo+rw
Sep 09 03:54:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:04 devstack sudo[93361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb
Sep 09 03:54:04 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:04 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb" returned: 0 in 0.307s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:04 devstack sudo[93364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.info
Sep 09 03:54:04 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:05 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.info" returned: 0 in 0.349s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:05 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.info is being set with open permissions: ugo+rw
Sep 09 03:54:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:05 devstack sudo[93367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.info
Sep 09 03:54:05 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:05 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.info" returned: 0 in 0.301s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.492s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:05 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e2fba41c-1ad6-4d35-84c7-b8938f007e5b tempest-SnapshotsActionsTest-870936567 None] Create snapshot completed successfully
Sep 09 03:54:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] Creating offline snapshot 1ea79a0b-5c43-456e-a49e-6d38d7f12420 of volume 989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:54:07 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaa0543-1607-4f49-87b1-c59bf4549b35]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:07 devstack sudo[93789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb
Sep 09 03:54:07 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:08 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb" returned: 0 in 0.436s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:54:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:08 devstack sudo[93796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420 1G
Sep 09 03:54:08 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:08 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420 1G" returned: 0 in 0.783s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:08 devstack sudo[93803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420
Sep 09 03:54:08 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:09 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420" returned: 0 in 0.630s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:09 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420 is being set with open permissions: ugo+rw
Sep 09 03:54:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:09 devstack sudo[93808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420
Sep 09 03:54:09 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:10 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420" returned: 0 in 0.469s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:10 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e32f0e50-5145-4416-9893-fc505746ebad tempest-SnapshotsActionsTest-870936567 None] Create snapshot completed successfully
Sep 09 03:54:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Acquiring lock "cinder-1ea79a0b-5c43-456e-a49e-6d38d7f12420-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-1ea79a0b-5c43-456e-a49e-6d38d7f12420-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Acquiring lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Acquiring lock "cinder-quobyte-1ea79a0b-5c43-456e-a49e-6d38d7f12420" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-1ea79a0b-5c43-456e-a49e-6d38d7f12420" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Deleting offline snapshot 1ea79a0b-5c43-456e-a49e-6d38d7f12420 of volume 989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:54:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] snapshot_file for this snap is: volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:54:11 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[df770012-d28d-4de7-83d6-33ebd5890ae7]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:11 devstack sudo[93813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420
Sep 09 03:54:11 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:11 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e00b37d8-cae7-4ddf-9c1c-e9060a88a9b5 tempest-GroupsTest-1091780620 None] Group tempest-Group1-1546314997: creating
Sep 09 03:54:11 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e00b37d8-cae7-4ddf-9c1c-e9060a88a9b5 tempest-GroupsTest-1091780620 None] Group tempest-Group1-1546314997: created successfully
Sep 09 03:54:11 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e00b37d8-cae7-4ddf-9c1c-e9060a88a9b5 tempest-GroupsTest-1091780620 None] Create group completed successfully.
Sep 09 03:54:11 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420" returned: 0 in 0.544s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:54:11 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf82980-fc84-49a6-9276-ce83223753da]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:11 devstack sudo[93820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb
Sep 09 03:54:11 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:12 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb" returned: 0 in 0.490s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:54:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:12 devstack sudo[93827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420
Sep 09 03:54:12 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:12 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8f3ff33e-a009-4310-915e-277caf886477 tempest-GroupsTest-1091780620 None] Group tempest-Group2-201794989: creating
Sep 09 03:54:12 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8f3ff33e-a009-4310-915e-277caf886477 tempest-GroupsTest-1091780620 None] Group tempest-Group2-201794989: created successfully
Sep 09 03:54:12 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8f3ff33e-a009-4310-915e-277caf886477 tempest-GroupsTest-1091780620 None] Create group completed successfully.
Sep 09 03:54:13 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420" returned: 0 in 0.891s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:13 devstack sudo[93835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420
Sep 09 03:54:13 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:13 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.1ea79a0b-5c43-456e-a49e-6d38d7f12420" returned: 0 in 0.455s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-1ea79a0b-5c43-456e-a49e-6d38d7f12420" released by "_delete_snapshot" :: held 2.552s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" released by "delete_snapshot" :: held 2.598s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:13 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Created reservations ['89a14398-92d6-46bb-968e-b2a95f1f0868', '67b87134-eb24-487d-9980-f3fc6ce8a002', '788b33a1-e512-4467-846c-1439e9306de0', '36271919-7dfe-4791-8d15-de9cbde6d84d'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:13 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Delete snapshot completed successfully.
Sep 09 03:54:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5020d2f-33a0-415e-963f-711e0fe429f5 tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-1ea79a0b-5c43-456e-a49e-6d38d7f12420-delete_snapshot" released by "delete_snapshot" :: held 2.874s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] Creating offline snapshot 33cea9aa-2a5a-4eff-b53e-f711b407d073 of volume 989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:54:14 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2b46e6-f5a5-4959-a9e3-49d3385817ff]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:15 devstack sudo[93841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb
Sep 09 03:54:15 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:15 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb" returned: 0 in 0.679s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:15 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:54:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:15 devstack sudo[93848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073 1G
Sep 09 03:54:15 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:15 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:54:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Flow 'volume_create_manager' (1098d72f-9794-4273-91ee-207bd9a6d623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:54:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6fa50e-a4f2-40b9-8b0d-f35186b0b67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6fa50e-a4f2-40b9-8b0d-f35186b0b67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-259831046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=755dd35b-f958-49fa-886f-e42d09601201,host='devstack@QuobyteHD#QuobyteHD',id=bd836d0c-b393-46af-99ea-8f3c6f3cf62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2afd9511b0f40cf872c3407b0732390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:16Z,use_quota=True,user_id='6c0925699dfe49d7961f382915f1c40a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8a2133d-b063-436c-a89c-8fe1df83488a),volume_type_id=d8a2133d-b063-436c-a89c-8fe1df83488a)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525915b0-4232-4fdc-bbd8-ee07447806cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525915b0-4232-4fdc-bbd8-ee07447806cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f8a76d-112b-444a-ab22-af1ffcc1b3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f8a76d-112b-444a-ab22-af1ffcc1b3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd836d0c-b393-46af-99ea-8f3c6f3cf62d', 'volume_name': 'volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92d02b9-b3bd-4f3c-9b43-3d4cb02d5fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92d02b9-b3bd-4f3c-9b43-3d4cb02d5fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bbc836-880f-4112-a09e-3693bfd832c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:16 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Volume bd836d0c-b393-46af-99ea-8f3c6f3cf62d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d', 'volume_size': 1}
Sep 09 03:54:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:16 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073 1G" returned: 0 in 0.935s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:16 devstack sudo[93855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073
Sep 09 03:54:16 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:17 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073" returned: 0 in 0.850s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:17 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073 is being set with open permissions: ugo+rw
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:17 devstack sudo[93872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073
Sep 09 03:54:17 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:17 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073" returned: 0 in 0.441s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.087s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.788s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=755dd35b-f958-49fa-886f-e42d09601201,created_at=2026-09-09T01:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-259831046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=755dd35b-f958-49fa-886f-e42d09601201,host='devstack@QuobyteHD#QuobyteHD',id=bd836d0c-b393-46af-99ea-8f3c6f3cf62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2afd9511b0f40cf872c3407b0732390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:16Z,use_quota=True,user_id='6c0925699dfe49d7961f382915f1c40a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8a2133d-b063-436c-a89c-8fe1df83488a),volume_type_id=d8a2133d-b063-436c-a89c-8fe1df83488a)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Creating volume bd836d0c-b393-46af-99ea-8f3c6f3cf62d {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:54:17 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:54:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:17 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a8eff5d4-9d39-4e8c-99cb-e7422528e7fe tempest-SnapshotsActionsTest-870936567 None] Create snapshot completed successfully
Sep 09 03:54:17 devstack sudo[93878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d 1073741824
Sep 09 03:54:17 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Acquiring lock "cinder-33cea9aa-2a5a-4eff-b53e-f711b407d073-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-33cea9aa-2a5a-4eff-b53e-f711b407d073-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Acquiring lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Acquiring lock "cinder-quobyte-33cea9aa-2a5a-4eff-b53e-f711b407d073" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-33cea9aa-2a5a-4eff-b53e-f711b407d073" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Deleting offline snapshot 33cea9aa-2a5a-4eff-b53e-f711b407d073 of volume 989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:54:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] snapshot_file for this snap is: volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:54:18 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f37d0f-7144-4688-bdfb-4b2053dfa277]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:18 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d 1073741824" returned: 0 in 0.755s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:18 devstack sudo[93893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073
Sep 09 03:54:18 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:18 devstack sudo[93895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d
Sep 09 03:54:18 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:19 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073" returned: 0 in 0.668s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:54:19 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b882ef7-9295-4c90-8dbf-2ea9151c2f5b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:19 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d" returned: 0 in 0.825s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:54:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bbc836-880f-4112-a09e-3693bfd832c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b361d341-5b03-4075-81c6-aaaa089a8318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:19 devstack sudo[93906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb
Sep 09 03:54:19 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:19 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Volume volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d (bd836d0c-b393-46af-99ea-8f3c6f3cf62d): created successfully
Sep 09 03:54:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b361d341-5b03-4075-81c6-aaaa089a8318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Flow 'volume_create_manager' (1098d72f-9794-4273-91ee-207bd9a6d623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:54:19 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-dbf3a5fa-484b-4362-b865-d125988d89fe tempest-GroupsTest-1091780620 None] Created volume successfully.
Sep 09 03:54:19 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb" returned: 0 in 0.591s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:54:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:20 devstack sudo[93912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073
Sep 09 03:54:20 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:20 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073" returned: 0 in 0.831s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:20 devstack sudo[93920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073
Sep 09 03:54:20 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:21 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.33cea9aa-2a5a-4eff-b53e-f711b407d073" returned: 0 in 0.394s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-33cea9aa-2a5a-4eff-b53e-f711b407d073" released by "_delete_snapshot" :: held 2.829s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" released by "delete_snapshot" :: held 2.898s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Acquiring lock "cinder-quobyte-bd836d0c-b393-46af-99ea-8f3c6f3cf62d" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Lock "cinder-quobyte-bd836d0c-b393-46af-99ea-8f3c6f3cf62d" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:21 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50d6b87-70ba-4152-971a-b72daffcd8b4]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:21 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Created reservations ['4c0bf65b-f3c8-4424-89b2-a6272aff626a', 'e1fdabb4-b095-4932-9d1c-80ec9f51d21d', '02d20272-e12d-43d7-bc55-0b8fc382e2f9', 'ca22c43c-87d6-4041-a6c3-5b7dcfad7daf'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:21 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Delete snapshot completed successfully.
Sep 09 03:54:21 devstack sudo[93982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d
Sep 09 03:54:21 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4724e88d-3013-4a1b-99bc-a784a3e04a6a tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-33cea9aa-2a5a-4eff-b53e-f711b407d073-delete_snapshot" released by "delete_snapshot" :: held 3.439s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:21 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-ec09ce5e-f89e-40ed-a17e-4618a5b84ab6 req-52c9c002-d749-4b95-895e-77d60e001e68 tempest-ServerActionsTestOtherA-1293361095 None] Terminate volume connection completed successfully.
Sep 09 03:54:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-ec09ce5e-f89e-40ed-a17e-4618a5b84ab6 req-52c9c002-d749-4b95-895e-77d60e001e68 tempest-ServerActionsTestOtherA-1293361095 None] Deleting attachment a19b4d8f-cb76-4f55-85cf-adf1df5aa466. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 03:54:22 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d" returned: 0 in 1.053s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:22 devstack sudo[94034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d
Sep 09 03:54:22 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] Creating offline snapshot b3544c2d-9d98-4b9e-b3e5-65f31304aca5 of volume 989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c563ad-42c0-4836-80d3-9884b892e984]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:23 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bd836d0c-b393-46af-99ea-8f3c6f3cf62d" returned: 0 in 0.525s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Lock "cinder-quobyte-bd836d0c-b393-46af-99ea-8f3c6f3cf62d" released by "delete_volume" :: held 1.695s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:23 devstack sudo[94044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb
Sep 09 03:54:23 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Created reservations ['4fdcd3c1-c77a-4ccc-9f1f-5ee2b0692080'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:23 devstack cinder-volume[87558]: WARNING cinder.quota [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2067792302 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2067792302, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:54:23 devstack cinder-volume[87558]: WARNING cinder.quota [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2067792302 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2067792302, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Created reservations ['cc46fd26-d89f-406f-b567-a3eba35c3b9f', 'ed53ab2f-e4f2-4d80-86c0-6a21c4ff1d76', '61804b6a-ad70-4622-b50e-f5682eca837e', '5aa22dc1-a598-4184-b404-448b1a6b1760'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:23 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb" returned: 0 in 0.777s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:54:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:23 devstack sudo[94057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:54:23 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:23 devstack sudo[94058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5 1G
Sep 09 03:54:23 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:24 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.413s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:24 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:54:24 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-34617faa-4660-4969-a88e-44ee330296ab tempest-GroupsTest-1091780620 None] Delete group completed successfully.
Sep 09 03:54:24 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5 1G" returned: 0 in 0.861s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:24 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-482e8654-1a96-4ed5-847f-7b09460cde91 tempest-GroupsTest-1091780620 None] Created reservations ['28a613fd-5bc3-49ee-aad3-906df5c44446'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:24 devstack sudo[94068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5
Sep 09 03:54:24 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-482e8654-1a96-4ed5-847f-7b09460cde91 tempest-GroupsTest-1091780620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-482e8654-1a96-4ed5-847f-7b09460cde91 tempest-GroupsTest-1091780620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-482e8654-1a96-4ed5-847f-7b09460cde91 tempest-GroupsTest-1091780620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-482e8654-1a96-4ed5-847f-7b09460cde91 tempest-GroupsTest-1091780620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-482e8654-1a96-4ed5-847f-7b09460cde91 tempest-GroupsTest-1091780620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-482e8654-1a96-4ed5-847f-7b09460cde91 tempest-GroupsTest-1091780620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:24 devstack sudo[94070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:54:24 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:25 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5" returned: 0 in 0.465s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:25 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5 is being set with open permissions: ugo+rw
Sep 09 03:54:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:25 devstack sudo[94076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5
Sep 09 03:54:25 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:25 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-482e8654-1a96-4ed5-847f-7b09460cde91 tempest-GroupsTest-1091780620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.454s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:25 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-482e8654-1a96-4ed5-847f-7b09460cde91 tempest-GroupsTest-1091780620 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:54:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-482e8654-1a96-4ed5-847f-7b09460cde91 tempest-GroupsTest-1091780620 None] Delete group completed successfully.
Sep 09 03:54:25 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5" returned: 0 in 0.325s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-ec09ce5e-f89e-40ed-a17e-4618a5b84ab6 req-ed0d6dad-24a8-4801-a817-c7ddf7793d53 tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-ec09ce5e-f89e-40ed-a17e-4618a5b84ab6 req-ed0d6dad-24a8-4801-a817-c7ddf7793d53 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-58f02fc9-bb54-43d9-a7f4-85d559b9797c tempest-SnapshotsActionsTest-870936567 None] Create snapshot completed successfully
Sep 09 03:54:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-ec09ce5e-f89e-40ed-a17e-4618a5b84ab6 req-ed0d6dad-24a8-4801-a817-c7ddf7793d53 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-ec09ce5e-f89e-40ed-a17e-4618a5b84ab6 req-ed0d6dad-24a8-4801-a817-c7ddf7793d53 tempest-ServerActionsTestOtherA-1293361095 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-621bf9ec-ad59-4457-a283-ab0c9cb41133', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a462851-7ab2-44aa-b7ac-ea09959e5917', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 03:54:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-ec09ce5e-f89e-40ed-a17e-4618a5b84ab6 req-ed0d6dad-24a8-4801-a817-c7ddf7793d53 tempest-ServerActionsTestOtherA-1293361095 None] attachment_update completed successfully.
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Acquiring lock "cinder-b3544c2d-9d98-4b9e-b3e5-65f31304aca5-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-b3544c2d-9d98-4b9e-b3e5-65f31304aca5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Acquiring lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Acquiring lock "cinder-quobyte-b3544c2d-9d98-4b9e-b3e5-65f31304aca5" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-b3544c2d-9d98-4b9e-b3e5-65f31304aca5" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Deleting offline snapshot b3544c2d-9d98-4b9e-b3e5-65f31304aca5 of volume 989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] snapshot_file for this snap is: volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e348d7-1e32-490e-9075-8383f0c18b44]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:26 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2fc58bbf-392c-42e1-bd17-7588c0acbd8c tempest-GroupsTest-1091780620 None] Group tempest-GroupsTest-Group-1064018041: creating
Sep 09 03:54:26 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2fc58bbf-392c-42e1-bd17-7588c0acbd8c tempest-GroupsTest-1091780620 None] Group tempest-GroupsTest-Group-1064018041: created successfully
Sep 09 03:54:26 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2fc58bbf-392c-42e1-bd17-7588c0acbd8c tempest-GroupsTest-1091780620 None] Create group completed successfully.
Sep 09 03:54:26 devstack sudo[94153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5
Sep 09 03:54:26 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:27 devstack sudo[94166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:54:27 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:27 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5" returned: 0 in 0.709s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:54:27 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9bca97-4995-42d9-a7ed-f8568430bedd]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:27 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.805s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:54:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:54:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 03:54:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 03:54:27 devstack sudo[94460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb
Sep 09 03:54:27 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Flow 'volume_create_manager' (e0e7a74e-5968-43f8-a97e-bd4b25226686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe53b2db-c810-41f9-a5d5-b1bfc68e2ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe53b2db-c810-41f9-a5d5-b1bfc68e2ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-624568342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ca66a4-9086-46c3-bc5e-d338ce6724d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687caee8093a4437891affc61f26254c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:28Z,use_quota=True,user_id='b9b074100907482aa62a1af06524a955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64c0153-c813-4e4c-ab04-6f0cef95e59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64c0153-c813-4e4c-ab04-6f0cef95e59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:28 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbe7275-89f2-4d24-acfd-9fa6deac5325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbe7275-89f2-4d24-acfd-9fa6deac5325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5ca66a4-9086-46c3-bc5e-d338ce6724d5', 'volume_name': 'volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8417b362-c065-4004-8867-3e3fac9cae87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8417b362-c065-4004-8867-3e3fac9cae87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12a69fa-d3fb-455a-bd5b-ee3050927543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:28 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Volume e5ca66a4-9086-46c3-bc5e-d338ce6724d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5', 'volume_size': 1}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-624568342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ca66a4-9086-46c3-bc5e-d338ce6724d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687caee8093a4437891affc61f26254c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:28Z,use_quota=True,user_id='b9b074100907482aa62a1af06524a955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Creating volume e5ca66a4-9086-46c3-bc5e-d338ce6724d5 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:54:28 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb" returned: 0 in 1.053s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:54:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:28 devstack sudo[94520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5 1073741824
Sep 09 03:54:28 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:28 devstack sudo[94521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5
Sep 09 03:54:28 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Flow 'volume_create_manager' (168dbead-d65b-4603-ade0-b0ff1ec8430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf76e8e-f524-4c9f-86de-48f87b169159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf76e8e-f524-4c9f-86de-48f87b169159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1417858252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ebf6d744-7b14-451c-b2cc-58847eb097bd,host='devstack@QuobyteHD#QuobyteHD',id=b26c69dc-3854-40fb-b1e8-6bba2c86f5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2afd9511b0f40cf872c3407b0732390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:29Z,use_quota=True,user_id='6c0925699dfe49d7961f382915f1c40a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02e721d3-ba9d-4217-9481-46e9596b38dc),volume_type_id=02e721d3-ba9d-4217-9481-46e9596b38dc)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3a09ef-4467-4e66-95b8-2296ab954d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3a09ef-4467-4e66-95b8-2296ab954d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44706907-0c02-485f-a2f5-ba31ec83b1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:29 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44706907-0c02-485f-a2f5-ba31ec83b1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b26c69dc-3854-40fb-b1e8-6bba2c86f5f5', 'volume_name': 'volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d63d2f-4aed-4bd0-b832-3c7055c99a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d63d2f-4aed-4bd0-b832-3c7055c99a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555d3699-879b-4edb-a45c-74f08dee6b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:29 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Volume b26c69dc-3854-40fb-b1e8-6bba2c86f5f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5', 'volume_size': 1}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5 1073741824" returned: 0 in 0.891s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:29 devstack sudo[94530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5
Sep 09 03:54:29 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:29 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5" returned: 0 in 1.039s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:29 devstack sudo[94532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5
Sep 09 03:54:29 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:29 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5" returned: 0 in 0.371s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ebf6d744-7b14-451c-b2cc-58847eb097bd,created_at=2026-09-09T01:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1417858252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ebf6d744-7b14-451c-b2cc-58847eb097bd,host='devstack@QuobyteHD#QuobyteHD',id=b26c69dc-3854-40fb-b1e8-6bba2c86f5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2afd9511b0f40cf872c3407b0732390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:29Z,use_quota=True,user_id='6c0925699dfe49d7961f382915f1c40a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02e721d3-ba9d-4217-9481-46e9596b38dc),volume_type_id=02e721d3-ba9d-4217-9481-46e9596b38dc)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Creating volume b26c69dc-3854-40fb-b1e8-6bba2c86f5f5 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:54:29 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12a69fa-d3fb-455a-bd5b-ee3050927543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc5f1c4-ae34-4596-8354-872ac0159a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:29 devstack sudo[94537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5 1073741824
Sep 09 03:54:29 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Volume volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5 (e5ca66a4-9086-46c3-bc5e-d338ce6724d5): created successfully
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc5f1c4-ae34-4596-8354-872ac0159a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:29 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Flow 'volume_create_manager' (e0e7a74e-5968-43f8-a97e-bd4b25226686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:54:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-98750095-25a0-4af9-a0ef-4dff51eb5a22 tempest-TestMinimumBasicScenario-915442973 None] Created volume successfully.
Sep 09 03:54:30 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.b3544c2d-9d98-4b9e-b3e5-65f31304aca5" returned: 0 in 0.537s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-b3544c2d-9d98-4b9e-b3e5-65f31304aca5" released by "_delete_snapshot" :: held 3.530s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" released by "delete_snapshot" :: held 3.575s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:30 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Created reservations ['690a120d-7ea5-4260-87d0-2cebcd015e71', '0f66c74c-f329-4f5d-b8a2-10092c67931b', 'daf08016-cbfd-4944-946f-95bd0fddb440', '7b428f87-4607-4008-b932-3ca4aa570454'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Delete snapshot completed successfully.
Sep 09 03:54:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7185954-df01-45ce-a3ce-b420dcda007c tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-b3544c2d-9d98-4b9e-b3e5-65f31304aca5-delete_snapshot" released by "delete_snapshot" :: held 4.071s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:31 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5 1073741824" returned: 0 in 1.156s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:31 devstack sudo[94543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5
Sep 09 03:54:31 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:31 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5" returned: 0 in 0.729s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:54:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.338s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] Creating offline snapshot 3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f of volume 989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:54:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555d3699-879b-4edb-a45c-74f08dee6b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b2b635-aeeb-4b0f-99b9-2003c8ff1322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:32 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5435f9-7eed-4d15-af31-770399ddbd7a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:32 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Volume volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5 (b26c69dc-3854-40fb-b1e8-6bba2c86f5f5): created successfully
Sep 09 03:54:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b2b635-aeeb-4b0f-99b9-2003c8ff1322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Flow 'volume_create_manager' (168dbead-d65b-4603-ade0-b0ff1ec8430e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:54:32 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4ae8c8d8-0c27-4aec-9028-9634e4973c5a tempest-GroupsTest-1091780620 None] Created volume successfully.
Sep 09 03:54:32 devstack sudo[94554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb
Sep 09 03:54:32 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:32 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb" returned: 0 in 0.637s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:54:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:32 devstack sudo[94568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f 1G
Sep 09 03:54:32 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-f9620e40-c618-46c6-b6ba-b9d3330e30dd req-710a3e65-bed9-4866-9a71-d976293f5986 tempest-TestMinimumBasicScenario-915442973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:33 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f 1G" returned: 0 in 0.597s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:33 devstack sudo[94574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f
Sep 09 03:54:33 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:33 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f" returned: 0 in 0.595s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:33 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f is being set with open permissions: ugo+rw
Sep 09 03:54:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:34 devstack sudo[94579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f
Sep 09 03:54:34 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:34 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f" returned: 0 in 0.599s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.774s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-f9620e40-c618-46c6-b6ba-b9d3330e30dd req-710a3e65-bed9-4866-9a71-d976293f5986 tempest-TestMinimumBasicScenario-915442973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.773s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-f9620e40-c618-46c6-b6ba-b9d3330e30dd req-710a3e65-bed9-4866-9a71-d976293f5986 tempest-TestMinimumBasicScenario-915442973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.080s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:34 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-31ce5668-300d-4ce1-9870-ea2fa1840f26 tempest-SnapshotsActionsTest-870936567 None] Create snapshot completed successfully
Sep 09 03:54:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-f9620e40-c618-46c6-b6ba-b9d3330e30dd req-710a3e65-bed9-4866-9a71-d976293f5986 tempest-TestMinimumBasicScenario-915442973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6673548-89f9-4712-8db5-d2473224ce99', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Flow 'volume_create_manager' (1651ed94-5a27-4bf8-8050-35e0613d8dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eee24a7-d8a3-49c0-a9b2-965cc5bd06fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:35 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-f9620e40-c618-46c6-b6ba-b9d3330e30dd req-710a3e65-bed9-4866-9a71-d976293f5986 tempest-TestMinimumBasicScenario-915442973 None] attachment_update completed successfully.
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eee24a7-d8a3-49c0-a9b2-965cc5bd06fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364035915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ebf6d744-7b14-451c-b2cc-58847eb097bd,host='devstack@QuobyteHD#QuobyteHD',id=244426d0-f73e-4671-ab48-ce33292110a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2afd9511b0f40cf872c3407b0732390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:35Z,use_quota=True,user_id='6c0925699dfe49d7961f382915f1c40a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02e721d3-ba9d-4217-9481-46e9596b38dc),volume_type_id=02e721d3-ba9d-4217-9481-46e9596b38dc)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ba0682-04b9-4e45-a038-b9130491a0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ba0682-04b9-4e45-a038-b9130491a0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6e4a80-2b37-410a-9133-f8b2aa10d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6e4a80-2b37-410a-9133-f8b2aa10d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244426d0-f73e-4671-ab48-ce33292110a0', 'volume_name': 'volume-244426d0-f73e-4671-ab48-ce33292110a0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2d9ddd-81a0-412a-a5e9-5e82130a275f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2d9ddd-81a0-412a-a5e9-5e82130a275f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0514d6a-4e61-4b84-a636-0e24d880bf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:35 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Volume 244426d0-f73e-4671-ab48-ce33292110a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244426d0-f73e-4671-ab48-ce33292110a0', 'volume_size': 1}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ebf6d744-7b14-451c-b2cc-58847eb097bd,created_at=2026-09-09T01:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364035915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ebf6d744-7b14-451c-b2cc-58847eb097bd,host='devstack@QuobyteHD#QuobyteHD',id=244426d0-f73e-4671-ab48-ce33292110a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2afd9511b0f40cf872c3407b0732390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:35Z,use_quota=True,user_id='6c0925699dfe49d7961f382915f1c40a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02e721d3-ba9d-4217-9481-46e9596b38dc),volume_type_id=02e721d3-ba9d-4217-9481-46e9596b38dc)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Creating volume 244426d0-f73e-4671-ab48-ce33292110a0 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:54:35 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-244426d0-f73e-4671-ab48-ce33292110a0 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:35 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-244426d0-f73e-4671-ab48-ce33292110a0 1073741824
Sep 09 03:54:35 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Acquiring lock "cinder-3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Acquiring lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Acquiring lock "cinder-quobyte-3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Deleting offline snapshot 3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f of volume 989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] snapshot_file for this snap is: volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[19865508-9994-41fe-8ff6-7606d580d197]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:36 devstack sudo[94591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f
Sep 09 03:54:36 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:36 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-244426d0-f73e-4671-ab48-ce33292110a0 1073741824" returned: 0 in 1.100s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-244426d0-f73e-4671-ab48-ce33292110a0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:36 devstack sudo[94597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-244426d0-f73e-4671-ab48-ce33292110a0
Sep 09 03:54:36 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:36 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f" returned: 0 in 0.897s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:54:36 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cfce4d-08cd-44be-829b-4835fd94e142]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:36 devstack sudo[94601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb
Sep 09 03:54:36 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:36 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-244426d0-f73e-4671-ab48-ce33292110a0" returned: 0 in 0.432s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:54:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0514d6a-4e61-4b84-a636-0e24d880bf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244426d0-f73e-4671-ab48-ce33292110a0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e26e0d-9710-4a97-bd4b-edb351ff60cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:37 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Volume volume-244426d0-f73e-4671-ab48-ce33292110a0 (244426d0-f73e-4671-ab48-ce33292110a0): created successfully
Sep 09 03:54:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e26e0d-9710-4a97-bd4b-edb351ff60cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Flow 'volume_create_manager' (1651ed94-5a27-4bf8-8050-35e0613d8dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:54:37 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2e1db8b9-7b9b-4e86-afab-29f5219706a3 tempest-GroupsTest-1091780620 None] Created volume successfully.
Sep 09 03:54:37 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb" returned: 0 in 0.775s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:54:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:37 devstack sudo[94609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f
Sep 09 03:54:37 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:38 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f" returned: 0 in 0.595s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:38 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-864d6921-02dc-46f8-8a47-fc66c104d7e9 tempest-GroupsTest-1091780620 None] Update group completed successfully.
Sep 09 03:54:38 devstack sudo[94643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f
Sep 09 03:54:38 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:38 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f" returned: 0 in 0.282s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f" released by "_delete_snapshot" :: held 2.723s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" released by "delete_snapshot" :: held 2.771s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:38 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Created reservations ['1bd20e51-a63a-4c02-9a0a-d65529ab378f', 'a485b382-7dd7-47d4-aef5-8221cec44de5', 'a1f4b8c8-81a0-4078-88a2-849b363c4622', '8f24ca9c-1c07-4de4-b7f4-69cdda120144'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:38 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Delete snapshot completed successfully.
Sep 09 03:54:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c514736-7927-4991-bdda-a05577b0cce8 tempest-SnapshotsActionsTest-1425575470 None] Lock "cinder-3a210ce2-b3cc-4fc4-b3b7-5e7f62356d4f-delete_snapshot" released by "delete_snapshot" :: held 3.017s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Acquiring lock "cinder-370e419d-2197-4db1-8ca3-af146f71b7cb-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Lock "cinder-370e419d-2197-4db1-8ca3-af146f71b7cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Acquiring lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Acquiring lock "cinder-quobyte-370e419d-2197-4db1-8ca3-af146f71b7cb" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Lock "cinder-quobyte-370e419d-2197-4db1-8ca3-af146f71b7cb" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Deleting offline snapshot 370e419d-2197-4db1-8ca3-af146f71b7cb of volume 989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:54:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] snapshot_file for this snap is: volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:54:39 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[905527d9-763a-404b-ad40-5c4d9fcb1ba5]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:39 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-eb80f29a-0d6b-4309-9ea0-eec1032218b6 tempest-GroupsTest-1091780620 None] Update group completed successfully.
Sep 09 03:54:39 devstack sudo[94646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb
Sep 09 03:54:39 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:40 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb" returned: 0 in 0.377s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:54:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[297f3e03-0146-4114-8b02-573b9f292be1]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:40 devstack sudo[94652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c
Sep 09 03:54:40 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:40 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c" returned: 0 in 0.403s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:40 devstack sudo[94659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb
Sep 09 03:54:40 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:40 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb" returned: 0 in 0.472s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:40 devstack sudo[94666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb
Sep 09 03:54:40 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:41 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c.370e419d-2197-4db1-8ca3-af146f71b7cb" returned: 0 in 0.371s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Lock "cinder-quobyte-370e419d-2197-4db1-8ca3-af146f71b7cb" released by "_delete_snapshot" :: held 1.770s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" released by "delete_snapshot" :: held 1.807s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:41 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Created reservations ['5e3d4e12-994a-4458-994d-d087e3ba9dd5', '0c8c3c77-be9f-407a-bc79-42e44d4e5bf5', 'e8df4fb6-5852-41c5-a253-51107e76c240', '55071da3-d3d5-43d7-bda3-04fe6b6bc7d2'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:41 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Delete snapshot completed successfully.
Sep 09 03:54:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4bf687b4-e054-4257-90f6-b57aa9639aed tempest-SnapshotsActionsTest-870936567 None] Lock "cinder-370e419d-2197-4db1-8ca3-af146f71b7cb-delete_snapshot" released by "delete_snapshot" :: held 2.084s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Acquiring lock "cinder-quobyte-244426d0-f73e-4671-ab48-ce33292110a0" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Lock "cinder-quobyte-244426d0-f73e-4671-ab48-ce33292110a0" acquired by "delete_volume" :: waited 0.050s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:41 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27d56e0-b0a9-49ff-84b2-dc49ab6685b4]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-244426d0-f73e-4671-ab48-ce33292110a0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Acquiring lock "cinder-989a1a35-bc4d-4d0f-b2f8-63b96944880c-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Lock "cinder-989a1a35-bc4d-4d0f-b2f8-63b96944880c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Acquiring lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" acquired by "delete_volume" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:42 devstack sudo[94669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-244426d0-f73e-4671-ab48-ce33292110a0
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23bfbf7-acfc-4a30-a845-63e7bc37d05b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:42 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:42 devstack sudo[94671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c
Sep 09 03:54:42 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:42 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-244426d0-f73e-4671-ab48-ce33292110a0" returned: 0 in 0.638s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-244426d0-f73e-4671-ab48-ce33292110a0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:42 devstack sudo[94676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-244426d0-f73e-4671-ab48-ce33292110a0
Sep 09 03:54:42 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:42 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c" returned: 0 in 0.511s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:42 devstack sudo[94681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c
Sep 09 03:54:42 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:42 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-244426d0-f73e-4671-ab48-ce33292110a0" returned: 0 in 0.343s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Lock "cinder-quobyte-244426d0-f73e-4671-ab48-ce33292110a0" released by "delete_volume" :: held 1.078s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Acquiring lock "cinder-quobyte-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Lock "cinder-quobyte-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4a01f2-62de-4605-9dba-71a2841b9258]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:43 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-989a1a35-bc4d-4d0f-b2f8-63b96944880c" returned: 0 in 0.341s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Lock "cinder-quobyte-989a1a35-bc4d-4d0f-b2f8-63b96944880c" released by "delete_volume" :: held 0.949s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Created reservations ['6865a8f1-505e-4505-bc47-5f1e8306a667', '67b88e3a-8af2-425b-9d29-e92ae18c0c76', '19f8667c-357f-4b39-ab72-61313fdb8bf0', 'a2eb8048-f383-42e1-be89-f77789bf7e0d'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:43 devstack sudo[94684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5
Sep 09 03:54:43 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:43 devstack sudo[94687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:54:43 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:43 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5" returned: 0 in 0.650s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:43 devstack sudo[94693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5
Sep 09 03:54:43 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:43 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.341s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:54:43 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Deleted volume successfully.
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6904031a-f03a-41e8-a731-e779d39a91b6 tempest-SnapshotsActionsTest-870936567 None] Lock "cinder-989a1a35-bc4d-4d0f-b2f8-63b96944880c-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:43 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5" returned: 0 in 0.283s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Lock "cinder-quobyte-b26c69dc-3854-40fb-b1e8-6bba2c86f5f5" released by "delete_volume" :: held 0.994s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:44 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Created reservations ['1969121f-a205-4633-874a-488a893b0b45'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:44 devstack cinder-volume[87558]: WARNING cinder.quota [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-937485543 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-937485543, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:54:44 devstack cinder-volume[87558]: WARNING cinder.quota [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-937485543 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-937485543, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:54:44 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Created reservations ['82a786dd-1462-42fe-bbed-de95d5218748', 'a0150ac0-aec4-4b2a-8885-972b310d1989', '50ede517-88d8-4970-b518-5ccd756e55eb', '258cae9a-3801-45bf-b20a-e3e8ee7df690'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:44 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Created reservations ['7dc169de-cf14-489e-bfee-13994e4ce732', '8135aa3a-bab2-400a-8998-40ff0ec5bbb2', '5e80a7eb-e560-4e37-9ce2-177c42ba8cf8', '5bf1482b-3e1d-4ed1-b28c-8a92d56cfd99'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:44 devstack sudo[94696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:54:44 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:44 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.399s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:44 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:54:44 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-05f2b134-d3c5-4ef6-8cb5-a3e8b5cedd21 tempest-GroupsTest-1091780620 None] Delete group completed successfully.
Sep 09 03:54:53 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-33231444-f50c-4d50-a41b-a75175102468 tempest-GroupsV320Test-782832326 None] Group tempest-GroupsV320Test-Group-1671541563: creating
Sep 09 03:54:53 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-33231444-f50c-4d50-a41b-a75175102468 tempest-GroupsV320Test-782832326 None] Group tempest-GroupsV320Test-Group-1671541563: created successfully
Sep 09 03:54:53 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-33231444-f50c-4d50-a41b-a75175102468 tempest-GroupsV320Test-782832326 None] Create group completed successfully.
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Flow 'volume_create_manager' (fe0d750e-5ee4-4a1b-b8b9-19782ade1405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bf6427-7bcd-4a64-b415-2d6e82199057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bf6427-7bcd-4a64-b415-2d6e82199057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2047175705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f713a96-e1e5-4322-81f8-c5350aa2a733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00af4dbddccf4e8498dd290238cc39a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:54Z,use_quota=True,user_id='4715b670acf7480c827db8666940f215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f120cd-8757-45a0-b344-ecc9c3ea2081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f120cd-8757-45a0-b344-ecc9c3ea2081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c54c90a-f495-41bc-bbfe-0ff2a91093b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c54c90a-f495-41bc-bbfe-0ff2a91093b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f713a96-e1e5-4322-81f8-c5350aa2a733', 'volume_name': 'volume-4f713a96-e1e5-4322-81f8-c5350aa2a733', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd03707-d0de-48cd-8894-92c6bb9c1536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd03707-d0de-48cd-8894-92c6bb9c1536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf784e6-fa7f-496e-b42d-b70a180bae73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:54 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Volume 4f713a96-e1e5-4322-81f8-c5350aa2a733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f713a96-e1e5-4322-81f8-c5350aa2a733', 'volume_size': 1}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2047175705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f713a96-e1e5-4322-81f8-c5350aa2a733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00af4dbddccf4e8498dd290238cc39a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:54Z,use_quota=True,user_id='4715b670acf7480c827db8666940f215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Creating volume 4f713a96-e1e5-4322-81f8-c5350aa2a733 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:54:54 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4f713a96-e1e5-4322-81f8-c5350aa2a733 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:54 devstack sudo[94760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4f713a96-e1e5-4322-81f8-c5350aa2a733 1073741824
Sep 09 03:54:54 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:54 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4f713a96-e1e5-4322-81f8-c5350aa2a733 1073741824" returned: 0 in 0.503s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4f713a96-e1e5-4322-81f8-c5350aa2a733 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:55 devstack sudo[94786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4f713a96-e1e5-4322-81f8-c5350aa2a733
Sep 09 03:54:55 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-d528df1f-e15b-4c01-b11c-43351bd2e31b tempest-GroupsV320Test-782832326 None] Created reservations ['840c032f-e0c1-4c9e-9e86-ed53b08ea7b9'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d528df1f-e15b-4c01-b11c-43351bd2e31b tempest-GroupsV320Test-782832326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d528df1f-e15b-4c01-b11c-43351bd2e31b tempest-GroupsV320Test-782832326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d528df1f-e15b-4c01-b11c-43351bd2e31b tempest-GroupsV320Test-782832326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d528df1f-e15b-4c01-b11c-43351bd2e31b tempest-GroupsV320Test-782832326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d528df1f-e15b-4c01-b11c-43351bd2e31b tempest-GroupsV320Test-782832326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d528df1f-e15b-4c01-b11c-43351bd2e31b tempest-GroupsV320Test-782832326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:55 devstack sudo[94790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:54:55 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:55 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4f713a96-e1e5-4322-81f8-c5350aa2a733" returned: 0 in 0.358s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf784e6-fa7f-496e-b42d-b70a180bae73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f713a96-e1e5-4322-81f8-c5350aa2a733', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b89a51a-6701-416c-86a9-497530877219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:55 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Volume volume-4f713a96-e1e5-4322-81f8-c5350aa2a733 (4f713a96-e1e5-4322-81f8-c5350aa2a733): created successfully
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b89a51a-6701-416c-86a9-497530877219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Flow 'volume_create_manager' (fe0d750e-5ee4-4a1b-b8b9-19782ade1405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:54:55 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6c9dfc5e-780e-4166-8567-334fb0dbc621 tempest-VolumeQuotasAdminTestJSON-1607901814 None] Created volume successfully.
Sep 09 03:54:55 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d528df1f-e15b-4c01-b11c-43351bd2e31b tempest-GroupsV320Test-782832326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.285s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:55 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-d528df1f-e15b-4c01-b11c-43351bd2e31b tempest-GroupsV320Test-782832326 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:54:55 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d528df1f-e15b-4c01-b11c-43351bd2e31b tempest-GroupsV320Test-782832326 None] Delete group completed successfully.
Sep 09 03:54:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Acquiring lock "cinder-4f713a96-e1e5-4322-81f8-c5350aa2a733-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "cinder-4f713a96-e1e5-4322-81f8-c5350aa2a733-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Acquiring lock "cinder-quobyte-4f713a96-e1e5-4322-81f8-c5350aa2a733" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:54:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "cinder-quobyte-4f713a96-e1e5-4322-81f8-c5350aa2a733" acquired by "delete_volume" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:54:56 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[472ad3a4-b23b-44ed-a822-8220b35d5da5]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:54:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4f713a96-e1e5-4322-81f8-c5350aa2a733 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:56 devstack sudo[94796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4f713a96-e1e5-4322-81f8-c5350aa2a733
Sep 09 03:54:56 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:57 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4f713a96-e1e5-4322-81f8-c5350aa2a733" returned: 0 in 0.430s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4f713a96-e1e5-4322-81f8-c5350aa2a733 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:57 devstack sudo[94802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4f713a96-e1e5-4322-81f8-c5350aa2a733
Sep 09 03:54:57 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:57 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4f713a96-e1e5-4322-81f8-c5350aa2a733" returned: 0 in 0.349s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "cinder-quobyte-4f713a96-e1e5-4322-81f8-c5350aa2a733" released by "delete_volume" :: held 0.853s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:57 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Created reservations ['f09601ba-6739-46b8-8d8a-2a888a21345d', '2c94afdd-2381-4413-86d9-e9b720c54b99', '0614c4ed-9263-413f-bf0e-7ef74c613147', '14782196-76c2-4324-a339-7ed3907c3f91'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:54:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:57 devstack sudo[94839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:54:57 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:58 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.359s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:54:58 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Deleted volume successfully.
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6a5a5a13-edcf-4d13-b6a4-7fed082c0f5d tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "cinder-4f713a96-e1e5-4322-81f8-c5350aa2a733-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Flow 'volume_create_manager' (44c22e88-8019-469c-a9a8-858e2a5a940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf569d0-27f8-4329-a471-c3cc9f35f866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf569d0-27f8-4329-a471-c3cc9f35f866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-859055694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b068ad8-1c85-4d02-9ba1-162a166616c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00af4dbddccf4e8498dd290238cc39a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:59Z,use_quota=True,user_id='4715b670acf7480c827db8666940f215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f87c581-bd11-4210-8cf5-553439e08a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f87c581-bd11-4210-8cf5-553439e08a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099cd85b-2ce6-4605-abfe-52548a88a6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099cd85b-2ce6-4605-abfe-52548a88a6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b068ad8-1c85-4d02-9ba1-162a166616c5', 'volume_name': 'volume-0b068ad8-1c85-4d02-9ba1-162a166616c5', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080f8c7e-90d9-4ab6-85eb-8810fee5768d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080f8c7e-90d9-4ab6-85eb-8810fee5768d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f915e66-5c1e-4276-a112-086d0a8b3f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:58 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Volume 0b068ad8-1c85-4d02-9ba1-162a166616c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b068ad8-1c85-4d02-9ba1-162a166616c5', 'volume_size': 1}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-859055694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b068ad8-1c85-4d02-9ba1-162a166616c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00af4dbddccf4e8498dd290238cc39a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:59Z,use_quota=True,user_id='4715b670acf7480c827db8666940f215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Creating volume 0b068ad8-1c85-4d02-9ba1-162a166616c5 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:54:58 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:54:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b068ad8-1c85-4d02-9ba1-162a166616c5 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:59 devstack sudo[94849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b068ad8-1c85-4d02-9ba1-162a166616c5 1073741824
Sep 09 03:54:59 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:59 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b068ad8-1c85-4d02-9ba1-162a166616c5 1073741824" returned: 0 in 0.457s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:59 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=113,cinder:UPDATE=114,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:54:59 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=131,cinder:UPDATE=112,cinder:INSERT=26,cinder:DELETE=5 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:54:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b068ad8-1c85-4d02-9ba1-162a166616c5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:54:59 devstack sudo[94858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b068ad8-1c85-4d02-9ba1-162a166616c5
Sep 09 03:54:59 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:54:59 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root
Sep 09 03:54:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b068ad8-1c85-4d02-9ba1-162a166616c5" returned: 0 in 0.295s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:54:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:54:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:54:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f915e66-5c1e-4276-a112-086d0a8b3f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b068ad8-1c85-4d02-9ba1-162a166616c5', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a1fe5d-6aa8-40fb-b77a-4cf68df6b6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:54:59 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Volume volume-0b068ad8-1c85-4d02-9ba1-162a166616c5 (0b068ad8-1c85-4d02-9ba1-162a166616c5): created successfully
Sep 09 03:54:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a1fe5d-6aa8-40fb-b77a-4cf68df6b6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:54:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Flow 'volume_create_manager' (44c22e88-8019-469c-a9a8-858e2a5a940c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:00 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-da08e157-e72a-4cbc-b830-728bc237cb5a tempest-VolumeQuotasAdminTestJSON-1607901814 None] Created volume successfully.
Sep 09 03:55:02 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4ac0a156-324f-48fc-9d35-941717cf3d27 tempest-VolumeQuotasAdminTestJSON-1972552766 None] Transfer volume completed successfully.
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Acquiring lock "cinder-0b068ad8-1c85-4d02-9ba1-162a166616c5-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Lock "cinder-0b068ad8-1c85-4d02-9ba1-162a166616c5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:03 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-5a5631ba-22ae-4ddb-b77c-91dba2e142cc tempest-ServerActionsTestOtherA-1293361095 None] Terminate volume connection completed successfully.
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-5a5631ba-22ae-4ddb-b77c-91dba2e142cc tempest-ServerActionsTestOtherA-1293361095 None] Deleting attachment 1a462851-7ab2-44aa-b7ac-ea09959e5917. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Acquiring lock "cinder-quobyte-0b068ad8-1c85-4d02-9ba1-162a166616c5" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Lock "cinder-quobyte-0b068ad8-1c85-4d02-9ba1-162a166616c5" acquired by "delete_volume" :: waited 0.028s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca3be6e-b288-4903-b183-bacfb1231bed]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b068ad8-1c85-4d02-9ba1-162a166616c5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:03 devstack sudo[95223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b068ad8-1c85-4d02-9ba1-162a166616c5
Sep 09 03:55:03 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "cinder-621bf9ec-ad59-4457-a283-ab0c9cb41133-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Lock "cinder-621bf9ec-ad59-4457-a283-ab0c9cb41133-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "cinder-quobyte-621bf9ec-ad59-4457-a283-ab0c9cb41133" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Lock "cinder-quobyte-621bf9ec-ad59-4457-a283-ab0c9cb41133" acquired by "delete_volume" :: waited 0.047s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4886b40-3cb9-4884-95b0-372e16f5de07]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:03 devstack sudo[95225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133
Sep 09 03:55:03 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:03 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b068ad8-1c85-4d02-9ba1-162a166616c5" returned: 0 in 0.593s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b068ad8-1c85-4d02-9ba1-162a166616c5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:03 devstack sudo[95230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b068ad8-1c85-4d02-9ba1-162a166616c5
Sep 09 03:55:03 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:04 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133" returned: 0 in 0.620s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:04 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b068ad8-1c85-4d02-9ba1-162a166616c5" returned: 0 in 0.488s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:04 devstack sudo[95236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133
Sep 09 03:55:04 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Lock "cinder-quobyte-0b068ad8-1c85-4d02-9ba1-162a166616c5" released by "delete_volume" :: held 1.172s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Created reservations ['24aa70d1-f6b9-4381-8f95-b271eda3b0de', 'b4d89e74-93e5-4d6c-801c-3469490c4f41', '94f746a4-21cf-40d9-9a43-33b129adf03d', 'e8082b03-dcf0-4d27-94c0-25616526dd3e'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:04 devstack sudo[95239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:55:04 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:04 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-621bf9ec-ad59-4457-a283-ab0c9cb41133" returned: 0 in 0.378s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Lock "cinder-quobyte-621bf9ec-ad59-4457-a283-ab0c9cb41133" released by "delete_volume" :: held 1.079s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG cinder.quota [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Created reservations ['58de5441-bfae-471d-8e54-45d64830febb', 'fb5fcb76-4009-4167-a997-7f5bcd6878c0', '3d25d865-353a-441d-b132-97f16d2aff7d', '214913e0-ff93-4b9d-9f6e-eb57a167de31'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:04 devstack sudo[95243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:55:04 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:04 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.347s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:55:04 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Deleted volume successfully.
Sep 09 03:55:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8a6ec2f6-752a-4092-a3a0-b196065ad53e tempest-VolumeQuotasAdminTestJSON-1843122487 None] Lock "cinder-0b068ad8-1c85-4d02-9ba1-162a166616c5-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:05 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.301s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:05 devstack cinder-volume[87558]: DEBUG cinder.manager [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:55:05 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Deleted volume successfully.
Sep 09 03:55:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-5b33b916-9ffe-4bc4-8d22-946ff00c2c38 req-a72e7305-458d-43ac-9098-a1d555033a8c tempest-ServerActionsTestOtherA-1293361095 None] Lock "cinder-621bf9ec-ad59-4457-a283-ab0c9cb41133-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "cinder-a8f77a03-229c-4b74-80da-ea71a6add0e4-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Lock "cinder-a8f77a03-229c-4b74-80da-ea71a6add0e4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "cinder-quobyte-a8f77a03-229c-4b74-80da-ea71a6add0e4" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Lock "cinder-quobyte-a8f77a03-229c-4b74-80da-ea71a6add0e4" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:05 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4be7d19-5262-4bef-83de-017a10040fce]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:55:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a8f77a03-229c-4b74-80da-ea71a6add0e4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:06 devstack sudo[95246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a8f77a03-229c-4b74-80da-ea71a6add0e4
Sep 09 03:55:06 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:06 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a8f77a03-229c-4b74-80da-ea71a6add0e4" returned: 0 in 0.584s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a8f77a03-229c-4b74-80da-ea71a6add0e4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:06 devstack sudo[95252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a8f77a03-229c-4b74-80da-ea71a6add0e4
Sep 09 03:55:06 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:06 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a8f77a03-229c-4b74-80da-ea71a6add0e4" returned: 0 in 0.341s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Lock "cinder-quobyte-a8f77a03-229c-4b74-80da-ea71a6add0e4" released by "delete_volume" :: held 0.990s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:07 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Created reservations ['b635268e-713b-429e-b416-f05592af6fd0', '33b90ab3-f6c8-4943-9e05-03d003cffb28', '32244230-2f4a-4f70-89e4-06e60101eda4', 'c6fc798b-1e47-44e7-94df-df60037d8eaa'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:55:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:07 devstack sudo[95255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:55:07 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:07 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.327s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:07 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:55:07 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Deleted volume successfully.
Sep 09 03:55:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a0a81ee3-330b-4c30-a90d-59cc757897f0 tempest-ServerActionsTestOtherA-1293361095 None] Lock "cinder-a8f77a03-229c-4b74-80da-ea71a6add0e4-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Flow 'volume_create_manager' (26b0a5ab-70ce-4313-8d9e-e321bc4e1699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793f7006-0bf8-4486-93eb-a18a834ab68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793f7006-0bf8-4486-93eb-a18a834ab68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1175730231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c386754-36b7-488a-b110-13a3879a7283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d6e4f87e7f43b3abbf37107378c10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:14Z,use_quota=True,user_id='386cff7d931b48dc8bea53e8d2ab212e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab6d850-17e5-4362-a655-f4ca5e20ca0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab6d850-17e5-4362-a655-f4ca5e20ca0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea94971-c13e-46fc-8abb-72ef512913d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea94971-c13e-46fc-8abb-72ef512913d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c386754-36b7-488a-b110-13a3879a7283', 'volume_name': 'volume-7c386754-36b7-488a-b110-13a3879a7283', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b717d58c-78a5-4192-9df1-ca0d2a409869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b717d58c-78a5-4192-9df1-ca0d2a409869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0286d13-4906-4759-8f1f-fe8594fca528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:14 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Volume 7c386754-36b7-488a-b110-13a3879a7283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c386754-36b7-488a-b110-13a3879a7283', 'volume_size': 1}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1175730231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c386754-36b7-488a-b110-13a3879a7283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d6e4f87e7f43b3abbf37107378c10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:14Z,use_quota=True,user_id='386cff7d931b48dc8bea53e8d2ab212e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Creating volume 7c386754-36b7-488a-b110-13a3879a7283 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:55:14 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7c386754-36b7-488a-b110-13a3879a7283 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:14 devstack sudo[95287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7c386754-36b7-488a-b110-13a3879a7283 1073741824
Sep 09 03:55:14 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:14 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7c386754-36b7-488a-b110-13a3879a7283 1073741824" returned: 0 in 0.541s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7c386754-36b7-488a-b110-13a3879a7283 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:14 devstack sudo[95380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7c386754-36b7-488a-b110-13a3879a7283
Sep 09 03:55:14 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:15 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7c386754-36b7-488a-b110-13a3879a7283" returned: 0 in 0.259s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:15 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:55:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0286d13-4906-4759-8f1f-fe8594fca528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c386754-36b7-488a-b110-13a3879a7283', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cf4f27-bd88-4887-88a7-dd225c866153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:15 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Volume volume-7c386754-36b7-488a-b110-13a3879a7283 (7c386754-36b7-488a-b110-13a3879a7283): created successfully
Sep 09 03:55:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cf4f27-bd88-4887-88a7-dd225c866153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Flow 'volume_create_manager' (26b0a5ab-70ce-4313-8d9e-e321bc4e1699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:15 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b41f12f1-5bea-46a4-9031-fb8694aaf329 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Created volume successfully.
Sep 09 03:55:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Acquiring lock "cinder-7c386754-36b7-488a-b110-13a3879a7283-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Lock "cinder-7c386754-36b7-488a-b110-13a3879a7283-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Acquiring lock "cinder-quobyte-7c386754-36b7-488a-b110-13a3879a7283" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Lock "cinder-quobyte-7c386754-36b7-488a-b110-13a3879a7283" acquired by "delete_volume" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:18 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac43453-1f15-4e03-9d61-b1267515db5c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:55:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7c386754-36b7-488a-b110-13a3879a7283 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:18 devstack sudo[95388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7c386754-36b7-488a-b110-13a3879a7283
Sep 09 03:55:18 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:18 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7c386754-36b7-488a-b110-13a3879a7283" returned: 0 in 0.494s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7c386754-36b7-488a-b110-13a3879a7283 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:18 devstack sudo[95393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7c386754-36b7-488a-b110-13a3879a7283
Sep 09 03:55:18 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:18 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7c386754-36b7-488a-b110-13a3879a7283" returned: 0 in 0.339s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Lock "cinder-quobyte-7c386754-36b7-488a-b110-13a3879a7283" released by "delete_volume" :: held 0.887s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:19 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Created reservations ['a118abdf-c66c-41d1-b75c-51c84bedefb7', '62a0d9c8-84e4-4d82-9e1b-9a4478cbfc3d', '190a04b8-198c-4918-a3df-7eacf39d6633', 'd8a65daf-4cc8-4d17-aadb-adeaddc5fdca'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:55:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:19 devstack sudo[95397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:55:19 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:19 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.417s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:19 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:55:19 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Deleted volume successfully.
Sep 09 03:55:19 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9fe9b157-af70-4a1b-959d-6f6bd9855d66 tempest-VolumeQuotasNegativeTestJSON-1344225846 None] Lock "cinder-7c386754-36b7-488a-b110-13a3879a7283-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:21 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-9e94cdef-f4b6-4167-822b-e7677a27f7e6 req-c2d84d0c-b5cf-4ff8-b43a-9605b710484d tempest-TestMinimumBasicScenario-915442973 None] Terminate volume connection completed successfully.
Sep 09 03:55:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-9e94cdef-f4b6-4167-822b-e7677a27f7e6 req-c2d84d0c-b5cf-4ff8-b43a-9605b710484d tempest-TestMinimumBasicScenario-915442973 None] Deleting attachment f6673548-89f9-4712-8db5-d2473224ce99. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 03:55:22 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Acquiring lock "cinder-e5ca66a4-9086-46c3-bc5e-d338ce6724d5-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:22 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Lock "cinder-e5ca66a4-9086-46c3-bc5e-d338ce6724d5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:22 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Acquiring lock "cinder-quobyte-e5ca66a4-9086-46c3-bc5e-d338ce6724d5" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:22 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Lock "cinder-quobyte-e5ca66a4-9086-46c3-bc5e-d338ce6724d5" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:22 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d0ef2a-ecfc-4085-aed7-cc81390b8b95]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:55:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:22 devstack sudo[95412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5
Sep 09 03:55:22 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:23 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5" returned: 0 in 0.440s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:23 devstack sudo[95417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5
Sep 09 03:55:23 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:23 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ca66a4-9086-46c3-bc5e-d338ce6724d5" returned: 0 in 0.354s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Lock "cinder-quobyte-e5ca66a4-9086-46c3-bc5e-d338ce6724d5" released by "delete_volume" :: held 0.868s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:23 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Created reservations ['4d1d5c87-fa4e-4516-a96e-fc5375e4d0ce', 'fb15cf72-b84a-498e-9e14-cd2f8f12d07a', 'b92db828-4316-4427-9421-56cd98549093', '4b16f27a-b46b-4cbb-87bf-d688e94b0831'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:55:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:23 devstack sudo[95420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:55:23 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:24 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.514s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:24 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:55:24 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Deleted volume successfully.
Sep 09 03:55:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f7786e2a-cddb-4576-8dde-5974daa0a0b0 tempest-TestMinimumBasicScenario-915442973 None] Lock "cinder-e5ca66a4-9086-46c3-bc5e-d338ce6724d5-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:55:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:27 devstack sudo[95447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:55:27 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:27 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.338s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:55:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:55:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 03:55:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Flow 'volume_create_manager' (86f184e7-6318-4f82-b3ff-6997e2671a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a007b4a-f47c-4daf-adc3-ea982fab6754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a007b4a-f47c-4daf-adc3-ea982fab6754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1360461141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02b26f9-48e2-4339-9844-2a3c66452d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83372f25b7874fceb2a8a18a363b9e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:29Z,use_quota=True,user_id='75c43017312443648a27d32f0269fdc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f0d5a7-381b-4b2c-a333-020c1bde25de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f0d5a7-381b-4b2c-a333-020c1bde25de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084d223a-d563-404a-9846-ee307415aedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084d223a-d563-404a-9846-ee307415aedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd02b26f9-48e2-4339-9844-2a3c66452d5d', 'volume_name': 'volume-d02b26f9-48e2-4339-9844-2a3c66452d5d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c658d6b-06eb-4733-9af7-7942533af769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c658d6b-06eb-4733-9af7-7942533af769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3848558b-7832-4746-9422-14f9d854cafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:29 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Volume d02b26f9-48e2-4339-9844-2a3c66452d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d02b26f9-48e2-4339-9844-2a3c66452d5d', 'volume_size': 1}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1360461141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02b26f9-48e2-4339-9844-2a3c66452d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83372f25b7874fceb2a8a18a363b9e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:29Z,use_quota=True,user_id='75c43017312443648a27d32f0269fdc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Creating volume d02b26f9-48e2-4339-9844-2a3c66452d5d {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:55:29 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:55:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b26f9-48e2-4339-9844-2a3c66452d5d 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:29 devstack sudo[95450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b26f9-48e2-4339-9844-2a3c66452d5d 1073741824
Sep 09 03:55:29 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:30 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b26f9-48e2-4339-9844-2a3c66452d5d 1073741824" returned: 0 in 0.531s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b26f9-48e2-4339-9844-2a3c66452d5d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:30 devstack sudo[95457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b26f9-48e2-4339-9844-2a3c66452d5d
Sep 09 03:55:30 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:30 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b26f9-48e2-4339-9844-2a3c66452d5d" returned: 0 in 0.291s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:55:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3848558b-7832-4746-9422-14f9d854cafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d02b26f9-48e2-4339-9844-2a3c66452d5d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03be1cb5-230b-41de-b96c-4f934b2f555c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:30 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Volume volume-d02b26f9-48e2-4339-9844-2a3c66452d5d (d02b26f9-48e2-4339-9844-2a3c66452d5d): created successfully
Sep 09 03:55:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03be1cb5-230b-41de-b96c-4f934b2f555c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Flow 'volume_create_manager' (86f184e7-6318-4f82-b3ff-6997e2671a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b1de98b9-d882-4865-a5c0-9a185e2f3a39 tempest-VolumesServicesTestJSON-447477976 None] Created volume successfully.
Sep 09 03:55:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Acquiring lock "cinder-d02b26f9-48e2-4339-9844-2a3c66452d5d-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Lock "cinder-d02b26f9-48e2-4339-9844-2a3c66452d5d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Acquiring lock "cinder-quobyte-d02b26f9-48e2-4339-9844-2a3c66452d5d" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Lock "cinder-quobyte-d02b26f9-48e2-4339-9844-2a3c66452d5d" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:31 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[76addf1c-e4d4-44e3-a495-92da478a394a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:55:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b26f9-48e2-4339-9844-2a3c66452d5d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:31 devstack sudo[95460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b26f9-48e2-4339-9844-2a3c66452d5d
Sep 09 03:55:31 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:32 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b26f9-48e2-4339-9844-2a3c66452d5d" returned: 0 in 0.437s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b26f9-48e2-4339-9844-2a3c66452d5d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:32 devstack sudo[95466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b26f9-48e2-4339-9844-2a3c66452d5d
Sep 09 03:55:32 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:32 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b26f9-48e2-4339-9844-2a3c66452d5d" returned: 0 in 0.255s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Lock "cinder-quobyte-d02b26f9-48e2-4339-9844-2a3c66452d5d" released by "delete_volume" :: held 0.737s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:32 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Created reservations ['897da241-ac10-46c7-8441-3b7e25e72852', 'b5221e81-c75a-4630-8b42-6bbcb8c615a0', 'feb99c37-dafd-4e0e-935f-d81ca87da965', '3048b019-b0a5-462b-94f9-bf17fc36d4fa'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:55:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:32 devstack sudo[95469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:55:32 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:33 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.328s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:33 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:55:33 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Deleted volume successfully.
Sep 09 03:55:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b61a00fe-85e0-4838-a172-3834d8b05863 tempest-VolumesServicesTestJSON-447477976 None] Lock "cinder-d02b26f9-48e2-4339-9844-2a3c66452d5d-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Flow 'volume_create_manager' (2b2de25e-ddab-494d-94dd-ac90aff898be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbb8be2-4546-459e-9cac-ce0afe59884e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbb8be2-4546-459e-9cac-ce0afe59884e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1929045855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64dff681-3413-40f5-919c-36b5fe86324f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae065fffcf44f45bc5fa19957ea1d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:42Z,use_quota=True,user_id='550f1acaed174dcfa6bb67b3c2e113f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b385cd94-c8ca-4941-830d-8158a1c81fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b385cd94-c8ca-4941-830d-8158a1c81fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f69f75-6cb6-45c8-93a7-7a5047706cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f69f75-6cb6-45c8-93a7-7a5047706cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64dff681-3413-40f5-919c-36b5fe86324f', 'volume_name': 'volume-64dff681-3413-40f5-919c-36b5fe86324f', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ab1659-6d41-4fb6-b3db-23bd6b73ce12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ab1659-6d41-4fb6-b3db-23bd6b73ce12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c8540a-0997-45c7-9978-a696805a6a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:42 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Volume 64dff681-3413-40f5-919c-36b5fe86324f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64dff681-3413-40f5-919c-36b5fe86324f', 'volume_size': 1}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1929045855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64dff681-3413-40f5-919c-36b5fe86324f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae065fffcf44f45bc5fa19957ea1d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:42Z,use_quota=True,user_id='550f1acaed174dcfa6bb67b3c2e113f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Creating volume 64dff681-3413-40f5-919c-36b5fe86324f {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:55:42 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:55:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-64dff681-3413-40f5-919c-36b5fe86324f 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:42 devstack sudo[95485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-64dff681-3413-40f5-919c-36b5fe86324f 1073741824
Sep 09 03:55:42 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:43 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-64dff681-3413-40f5-919c-36b5fe86324f 1073741824" returned: 0 in 0.892s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-64dff681-3413-40f5-919c-36b5fe86324f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:43 devstack sudo[95492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-64dff681-3413-40f5-919c-36b5fe86324f
Sep 09 03:55:43 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:43 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-64dff681-3413-40f5-919c-36b5fe86324f" returned: 0 in 0.510s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:55:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c8540a-0997-45c7-9978-a696805a6a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64dff681-3413-40f5-919c-36b5fe86324f', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27ed14e-11c3-499a-abae-d9b58092a1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:44 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Volume volume-64dff681-3413-40f5-919c-36b5fe86324f (64dff681-3413-40f5-919c-36b5fe86324f): created successfully
Sep 09 03:55:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27ed14e-11c3-499a-abae-d9b58092a1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Flow 'volume_create_manager' (2b2de25e-ddab-494d-94dd-ac90aff898be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:44 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9a54ce0f-6648-4670-83d8-805c56596b80 tempest-VolumesListAdminTestJSON-132295492 None] Created volume successfully.
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Flow 'volume_create_manager' (b9e49844-8ee6-4fd2-a448-8aaeea935f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4058bbc5-aee9-4784-a6de-50d810718b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4058bbc5-aee9-4784-a6de-50d810718b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1743649615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c127635d-d970-4f29-80c5-a02b853a194b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae065fffcf44f45bc5fa19957ea1d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:46Z,use_quota=True,user_id='550f1acaed174dcfa6bb67b3c2e113f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534b8ac6-cce3-4fa7-89cb-23bbb7993cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534b8ac6-cce3-4fa7-89cb-23bbb7993cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b5b967-73e0-467b-ab29-40897b916dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b5b967-73e0-467b-ab29-40897b916dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c127635d-d970-4f29-80c5-a02b853a194b', 'volume_name': 'volume-c127635d-d970-4f29-80c5-a02b853a194b', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde15ff5-8acd-4988-9896-7e2315b407aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde15ff5-8acd-4988-9896-7e2315b407aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e004b5-2ceb-4464-9709-ed966d6db6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:45 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Volume c127635d-d970-4f29-80c5-a02b853a194b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c127635d-d970-4f29-80c5-a02b853a194b', 'volume_size': 1}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1743649615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c127635d-d970-4f29-80c5-a02b853a194b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae065fffcf44f45bc5fa19957ea1d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:46Z,use_quota=True,user_id='550f1acaed174dcfa6bb67b3c2e113f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Creating volume c127635d-d970-4f29-80c5-a02b853a194b {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:55:45 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:55:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c127635d-d970-4f29-80c5-a02b853a194b 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:45 devstack sudo[95527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c127635d-d970-4f29-80c5-a02b853a194b 1073741824
Sep 09 03:55:45 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:55:46 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Flow 'volume_create_manager' (2663e3a1-10e3-4798-af36-0751381ae32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1bd54c0-110e-4536-877f-1accbdb6b6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c127635d-d970-4f29-80c5-a02b853a194b 1073741824" returned: 0 in 0.817s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1bd54c0-110e-4536-877f-1accbdb6b6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1270370335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d24a0ea-5843-4c17-8227-a3a8c0d31b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1dab397d204515ae7bf7b2008b848a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:46Z,use_quota=True,user_id='8536c54635054d118b0fe798271b355e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bea4c55-f8f7-4380-8efe-ef8c725aee76),volume_type_id=2bea4c55-f8f7-4380-8efe-ef8c725aee76)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031bbcbe-8bc1-4baf-8723-b8afee9e6929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031bbcbe-8bc1-4baf-8723-b8afee9e6929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5494d975-12db-4fd0-8c7f-58cd47d9f470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5494d975-12db-4fd0-8c7f-58cd47d9f470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d24a0ea-5843-4c17-8227-a3a8c0d31b6a', 'volume_name': 'volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8061e7cd-65d6-407f-a1b8-d1701d9810f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8061e7cd-65d6-407f-a1b8-d1701d9810f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e86b52-b248-4318-a818-9100c13b7510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:46 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Volume 4d24a0ea-5843-4c17-8227-a3a8c0d31b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a', 'volume_size': 1}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c127635d-d970-4f29-80c5-a02b853a194b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:46 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c127635d-d970-4f29-80c5-a02b853a194b
Sep 09 03:55:46 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:46 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c127635d-d970-4f29-80c5-a02b853a194b" returned: 0 in 0.308s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1270370335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d24a0ea-5843-4c17-8227-a3a8c0d31b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1dab397d204515ae7bf7b2008b848a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:46Z,use_quota=True,user_id='8536c54635054d118b0fe798271b355e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bea4c55-f8f7-4380-8efe-ef8c725aee76),volume_type_id=2bea4c55-f8f7-4380-8efe-ef8c725aee76)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Creating volume 4d24a0ea-5843-4c17-8227-a3a8c0d31b6a {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:55:46 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:55:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e004b5-2ceb-4464-9709-ed966d6db6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c127635d-d970-4f29-80c5-a02b853a194b', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f635ac-1a15-481a-adcb-3321197f74a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:47 devstack sudo[95539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a 1073741824
Sep 09 03:55:47 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:47 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Volume volume-c127635d-d970-4f29-80c5-a02b853a194b (c127635d-d970-4f29-80c5-a02b853a194b): created successfully
Sep 09 03:55:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f635ac-1a15-481a-adcb-3321197f74a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Flow 'volume_create_manager' (b9e49844-8ee6-4fd2-a448-8aaeea935f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:47 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-095620bf-4d51-4b66-8db2-8aab0b7ed116 tempest-VolumesListAdminTestJSON-132295492 None] Created volume successfully.
Sep 09 03:55:47 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a 1073741824" returned: 0 in 0.636s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:47 devstack sudo[95545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a
Sep 09 03:55:47 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:48 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a" returned: 0 in 0.401s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e86b52-b248-4318-a818-9100c13b7510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae9b9b4-6007-43e6-b14c-7556edc89d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:48 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Volume volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a (4d24a0ea-5843-4c17-8227-a3a8c0d31b6a): created successfully
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae9b9b4-6007-43e6-b14c-7556edc89d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Flow 'volume_create_manager' (2663e3a1-10e3-4798-af36-0751381ae32e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:48 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0c552cbc-e603-4665-94ef-50f89ec2ab8c tempest-VolumeTypesAccessTest-70590264 None] Created volume successfully.
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Flow 'volume_create_manager' (162282f7-5216-4a13-9200-7a6a91e5eec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c559e8b3-b810-465c-8588-a5f2fe6f22ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c559e8b3-b810-465c-8588-a5f2fe6f22ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2139586260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fbbcb94-dda4-4a72-b966-23d4a74537e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae065fffcf44f45bc5fa19957ea1d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:48Z,use_quota=True,user_id='550f1acaed174dcfa6bb67b3c2e113f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9f63ed-0c18-4155-ae7f-e16363aa704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9f63ed-0c18-4155-ae7f-e16363aa704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a88c7c4-2a31-47e8-adb3-cc9c87ab5497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a88c7c4-2a31-47e8-adb3-cc9c87ab5497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fbbcb94-dda4-4a72-b966-23d4a74537e8', 'volume_name': 'volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac799ead-828f-40ec-8c3c-7463d38af03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac799ead-828f-40ec-8c3c-7463d38af03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d0f309-1fba-440c-bb9a-a1d6c3beed28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:48 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Volume 0fbbcb94-dda4-4a72-b966-23d4a74537e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8', 'volume_size': 1}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2139586260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fbbcb94-dda4-4a72-b966-23d4a74537e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae065fffcf44f45bc5fa19957ea1d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:48Z,use_quota=True,user_id='550f1acaed174dcfa6bb67b3c2e113f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Creating volume 0fbbcb94-dda4-4a72-b966-23d4a74537e8 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:55:48 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:48 devstack sudo[95549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8 1073741824
Sep 09 03:55:48 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Acquiring lock "cinder-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Lock "cinder-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Acquiring lock "cinder-quobyte-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Lock "cinder-quobyte-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[13993e84-2bf9-4342-bc58-327ad961c5ea]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:55:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:49 devstack sudo[95555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a
Sep 09 03:55:49 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:49 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8 1073741824" returned: 0 in 0.618s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:49 devstack sudo[95557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8
Sep 09 03:55:49 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:49 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a" returned: 0 in 0.839s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:49 devstack sudo[95587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a
Sep 09 03:55:49 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:50 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8" returned: 0 in 0.807s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d0f309-1fba-440c-bb9a-a1d6c3beed28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007f13b5-ba47-450c-97d5-5b20d530fe29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:50 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Volume volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8 (0fbbcb94-dda4-4a72-b966-23d4a74537e8): created successfully
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007f13b5-ba47-450c-97d5-5b20d530fe29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Flow 'volume_create_manager' (162282f7-5216-4a13-9200-7a6a91e5eec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:50 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b6f9b990-4983-4e9b-acbb-acc29ee2e043 tempest-VolumesListAdminTestJSON-132295492 None] Created volume successfully.
Sep 09 03:55:50 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a" returned: 0 in 0.640s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Lock "cinder-quobyte-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a" released by "delete_volume" :: held 1.537s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:50 devstack cinder-volume[87558]: WARNING cinder.quota [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-643374171 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-643374171, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:55:50 devstack cinder-volume[87558]: WARNING cinder.quota [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-643374171 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-643374171, it is now deprecated. Please use the default quota class for default quota.
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Created reservations ['d5118b7b-bc3d-40e3-9c89-bad107ef0a63', '8831bf20-423a-47d8-a657-c38742d0e2a6', '575457f5-508e-429a-b284-fd7908b2e585', 'dc5c579b-7e8f-43a9-adf5-a87231567a1a'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:50 devstack sudo[95653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:55:50 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:51 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.927s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:51 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:55:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Deleted volume successfully.
Sep 09 03:55:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fc1fe81e-9eae-4db7-a443-b887c792273a tempest-VolumeTypesAccessTest-70590264 None] Lock "cinder-4d24a0ea-5843-4c17-8227-a3a8c0d31b6a-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Flow 'volume_create_manager' (637e3479-7e2c-4afc-8507-f3f4311e792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7115f2-80fb-44ce-823e-27339b3db8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7115f2-80fb-44ce-823e-27339b3db8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0afdc31d-6209-4443-a09a-bfc486a4c2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8354401a997544b8b8b94b7aa63ad165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:53Z,use_quota=True,user_id='71f88ef8292f4adf9d250f72a98901b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01015a7-04d7-4fe4-b190-96f1ea84030c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01015a7-04d7-4fe4-b190-96f1ea84030c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a5beea-58f9-4918-9ced-fb63d65be85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a5beea-58f9-4918-9ced-fb63d65be85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0afdc31d-6209-4443-a09a-bfc486a4c2eb', 'volume_name': 'volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8bff78-7e40-495b-b318-a91bda124017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8bff78-7e40-495b-b318-a91bda124017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443bd2a2-72d9-4454-8571-b882ff7590a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:53 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Volume 0afdc31d-6209-4443-a09a-bfc486a4c2eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb', 'volume_size': 1}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0afdc31d-6209-4443-a09a-bfc486a4c2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8354401a997544b8b8b94b7aa63ad165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:53Z,use_quota=True,user_id='71f88ef8292f4adf9d250f72a98901b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Creating volume 0afdc31d-6209-4443-a09a-bfc486a4c2eb {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:55:53 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:55:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:53 devstack sudo[95674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb 1073741824
Sep 09 03:55:53 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:54 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb 1073741824" returned: 0 in 0.696s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:54 devstack sudo[95681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb
Sep 09 03:55:54 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:54 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb" returned: 0 in 0.345s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:55:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443bd2a2-72d9-4454-8571-b882ff7590a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1b572b-15db-4cb0-9500-30d8d841249a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:55:54 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Volume volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb (0afdc31d-6209-4443-a09a-bfc486a4c2eb): created successfully
Sep 09 03:55:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1b572b-15db-4cb0-9500-30d8d841249a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:55:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Flow 'volume_create_manager' (637e3479-7e2c-4afc-8507-f3f4311e792d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:55:54 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-cb8a3e60-b3cd-4770-8b0a-32b42b13f013 tempest-VolumesListAdminTestJSON-1997955866 None] Created volume successfully.
Sep 09 03:55:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Acquiring lock "cinder-0afdc31d-6209-4443-a09a-bfc486a4c2eb-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Lock "cinder-0afdc31d-6209-4443-a09a-bfc486a4c2eb-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Acquiring lock "cinder-quobyte-0afdc31d-6209-4443-a09a-bfc486a4c2eb" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Lock "cinder-quobyte-0afdc31d-6209-4443-a09a-bfc486a4c2eb" acquired by "delete_volume" :: waited 0.053s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "cinder-0fbbcb94-dda4-4a72-b966-23d4a74537e8-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:56 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39cb359-8368-4153-a579-16220a822909]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:55:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Lock "cinder-0fbbcb94-dda4-4a72-b966-23d4a74537e8-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "cinder-quobyte-0fbbcb94-dda4-4a72-b966-23d4a74537e8" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:55:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Lock "cinder-quobyte-0fbbcb94-dda4-4a72-b966-23d4a74537e8" acquired by "delete_volume" :: waited 0.053s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:55:56 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f6680b-7f52-4d14-9152-603826afa2a4]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:55:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:56 devstack sudo[95687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb
Sep 09 03:55:56 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:56 devstack sudo[95688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8
Sep 09 03:55:56 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:57 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8" returned: 0 in 0.673s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:57 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb" returned: 0 in 1.031s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:57 devstack sudo[95697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8
Sep 09 03:55:57 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:57 devstack sudo[95699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb
Sep 09 03:55:57 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:57 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0fbbcb94-dda4-4a72-b966-23d4a74537e8" returned: 0 in 0.898s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Lock "cinder-quobyte-0fbbcb94-dda4-4a72-b966-23d4a74537e8" released by "delete_volume" :: held 1.746s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:58 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0afdc31d-6209-4443-a09a-bfc486a4c2eb" returned: 0 in 0.962s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Lock "cinder-quobyte-0afdc31d-6209-4443-a09a-bfc486a4c2eb" released by "delete_volume" :: held 2.145s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Created reservations ['daeba29a-7520-4e97-9bd0-b5f43a465dad', '1e53d13d-407e-4527-9f3a-a29bbf3c1897', 'bc5d0fb4-327e-4611-bfb1-70757eff55d4', 'c188ee9b-59aa-4fec-9ed9-6268fffcd904'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Created reservations ['6c63a49d-31d7-4649-9156-46e04aa4947e', '38d5cfb0-487a-42fc-a628-72310b0a8891', 'aa369251-3906-4164-8aa6-19c8d24688d6', '760f96ae-5c21-4ec0-b909-3273afd77765'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:58 devstack sudo[95703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:55:58 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:55:58 devstack sudo[95705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:55:58 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:55:58 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.331s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:55:58 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Deleted volume successfully.
Sep 09 03:55:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fddc714b-ace3-43bc-9b03-37af774f83e3 tempest-VolumesListAdminTestJSON-132295492 None] Lock "cinder-0fbbcb94-dda4-4a72-b966-23d4a74537e8-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:59 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root
Sep 09 03:55:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.857s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:55:59 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:55:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Deleted volume successfully.
Sep 09 03:55:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2ea19fa3-b57e-4c6e-92a8-b83380427718 tempest-VolumesListAdminTestJSON-1997955866 None] Lock "cinder-0afdc31d-6209-4443-a09a-bfc486a4c2eb-delete_volume" released by "delete_volume" :: held 3.712s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:55:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "cinder-c127635d-d970-4f29-80c5-a02b853a194b-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:56:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Lock "cinder-c127635d-d970-4f29-80c5-a02b853a194b-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:56:00 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=92,cinder:DELETE=11,cinder:SELECT=65,cinder:INSERT=23 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:56:00 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=60,cinder:INSERT=21,cinder:UPDATE=99,cinder:DELETE=6 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:56:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "cinder-quobyte-c127635d-d970-4f29-80c5-a02b853a194b" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:56:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Lock "cinder-quobyte-c127635d-d970-4f29-80c5-a02b853a194b" acquired by "delete_volume" :: waited 0.059s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:56:00 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff89b446-e04b-42ce-a9f1-210b5ce9f297]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:56:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c127635d-d970-4f29-80c5-a02b853a194b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:00 devstack sudo[95745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c127635d-d970-4f29-80c5-a02b853a194b
Sep 09 03:56:00 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:01 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c127635d-d970-4f29-80c5-a02b853a194b" returned: 0 in 0.721s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c127635d-d970-4f29-80c5-a02b853a194b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:01 devstack sudo[95751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c127635d-d970-4f29-80c5-a02b853a194b
Sep 09 03:56:01 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:01 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c127635d-d970-4f29-80c5-a02b853a194b" returned: 0 in 0.619s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Lock "cinder-quobyte-c127635d-d970-4f29-80c5-a02b853a194b" released by "delete_volume" :: held 1.499s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:56:01 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Created reservations ['c2eaf2e4-c3b5-475f-b546-f3822f4ae6cf', '247536c0-1142-49bc-a129-0b5c412224fa', '81cd6fd1-c856-40c8-b281-7cfdda48c253', 'dda92ed2-69ee-4371-8ac4-08f4340d64e7'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:56:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:56:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:56:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:56:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:56:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:02 devstack sudo[95754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:56:02 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:02 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.300s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:02 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:56:02 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Deleted volume successfully.
Sep 09 03:56:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f09658fb-c7ca-449d-adef-89db3057bb23 tempest-VolumesListAdminTestJSON-132295492 None] Lock "cinder-c127635d-d970-4f29-80c5-a02b853a194b-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:56:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "cinder-64dff681-3413-40f5-919c-36b5fe86324f-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:56:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Lock "cinder-64dff681-3413-40f5-919c-36b5fe86324f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:56:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "cinder-quobyte-64dff681-3413-40f5-919c-36b5fe86324f" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:56:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Lock "cinder-quobyte-64dff681-3413-40f5-919c-36b5fe86324f" acquired by "delete_volume" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:56:03 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1960732f-00d5-4ca6-ba3e-08de94178263]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:56:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-64dff681-3413-40f5-919c-36b5fe86324f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:03 devstack sudo[95757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-64dff681-3413-40f5-919c-36b5fe86324f
Sep 09 03:56:03 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:03 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-64dff681-3413-40f5-919c-36b5fe86324f" returned: 0 in 0.678s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-64dff681-3413-40f5-919c-36b5fe86324f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:03 devstack sudo[95762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-64dff681-3413-40f5-919c-36b5fe86324f
Sep 09 03:56:03 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:04 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-64dff681-3413-40f5-919c-36b5fe86324f" returned: 0 in 0.683s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Lock "cinder-quobyte-64dff681-3413-40f5-919c-36b5fe86324f" released by "delete_volume" :: held 1.479s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:56:04 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Created reservations ['4582df35-bfa1-4336-b796-0401f412029e', '661acde2-f676-4b19-8e98-d52b5492d0da', '093c6d54-1e43-4983-b420-0286e1238ab9', 'a587b9c4-d4ef-45c5-b299-779d0de35dab'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:56:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:56:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:56:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:56:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:56:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:04 devstack sudo[95766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:56:05 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:05 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.807s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:05 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:56:05 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Deleted volume successfully.
Sep 09 03:56:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1a3ce3d6-48b7-47b4-9959-76d24b2e6299 tempest-VolumesListAdminTestJSON-132295492 None] Lock "cinder-64dff681-3413-40f5-919c-36b5fe86324f-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Flow 'volume_create_manager' (571cb064-7249-43a1-a406-dbd4006cf0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a883a89-b515-4f82-afda-0274f9b56bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a883a89-b515-4f82-afda-0274f9b56bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-289862171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2559717-c956-4fd7-82c9-b64d2dd3d7a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cd63faf65440d48fec18073ee4ca5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:12Z,use_quota=True,user_id='f7ccdc15878d4cc6a54d034df3c106c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3682f5-2152-4b3d-a34a-f4ad65048e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3682f5-2152-4b3d-a34a-f4ad65048e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7bc184-504b-4bdd-84ef-cf3174b965cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7bc184-504b-4bdd-84ef-cf3174b965cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2559717-c956-4fd7-82c9-b64d2dd3d7a8', 'volume_name': 'volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a0538c-f196-4b26-bfbb-46b9e6291582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a0538c-f196-4b26-bfbb-46b9e6291582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32257cc7-dff0-4a0d-9b43-736396b346bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:12 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Volume c2559717-c956-4fd7-82c9-b64d2dd3d7a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8', 'volume_size': 1}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-289862171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2559717-c956-4fd7-82c9-b64d2dd3d7a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cd63faf65440d48fec18073ee4ca5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:12Z,use_quota=True,user_id='f7ccdc15878d4cc6a54d034df3c106c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Creating volume c2559717-c956-4fd7-82c9-b64d2dd3d7a8 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:56:12 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:12 devstack sudo[95846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8 1073741824
Sep 09 03:56:12 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:12 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8 1073741824" returned: 0 in 0.692s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:13 devstack sudo[95852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8
Sep 09 03:56:13 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:13 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8" returned: 0 in 0.581s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:56:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:56:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32257cc7-dff0-4a0d-9b43-736396b346bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339176e3-ca47-446a-aed5-23d192e92ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:13 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Volume volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8 (c2559717-c956-4fd7-82c9-b64d2dd3d7a8): created successfully
Sep 09 03:56:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339176e3-ca47-446a-aed5-23d192e92ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Flow 'volume_create_manager' (571cb064-7249-43a1-a406-dbd4006cf0fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:56:13 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-156aeacd-4f75-44e4-90e7-7bb5c676e6ce tempest-ServerRescueNegativeTestJSON-473491782 None] Created volume successfully.
Sep 09 03:56:16 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Flow 'volume_create_manager' (793a3f0c-1865-4275-b770-6131170350ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7648f89c-7010-4eff-bfe1-282e6d3df626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7648f89c-7010-4eff-bfe1-282e6d3df626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1608076765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72bc593-909b-48b0-95e9-8e1b1debc711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970905effd10450b9d0b494752637cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:17Z,use_quota=True,user_id='b2115399e57a4ddaac34a74217bb8394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb50e60-117f-4316-bbce-c02927a40410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb50e60-117f-4316-bbce-c02927a40410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3cb52d-a59a-4966-8947-2b83204f9a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3cb52d-a59a-4966-8947-2b83204f9a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b72bc593-909b-48b0-95e9-8e1b1debc711', 'volume_name': 'volume-b72bc593-909b-48b0-95e9-8e1b1debc711', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2760b4e1-7199-421d-93b9-a27201839051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2760b4e1-7199-421d-93b9-a27201839051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b03de78-410f-487b-be1c-f8f98ea70c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:17 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Volume b72bc593-909b-48b0-95e9-8e1b1debc711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b72bc593-909b-48b0-95e9-8e1b1debc711', 'volume_size': 1}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1608076765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72bc593-909b-48b0-95e9-8e1b1debc711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970905effd10450b9d0b494752637cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:17Z,use_quota=True,user_id='b2115399e57a4ddaac34a74217bb8394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Creating volume b72bc593-909b-48b0-95e9-8e1b1debc711 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:56:17 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:56:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:17 devstack sudo[95857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711 1073741824
Sep 09 03:56:17 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:18 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711 1073741824" returned: 0 in 1.090s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:18 devstack sudo[95874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711
Sep 09 03:56:18 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:18 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711" returned: 0 in 0.382s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:56:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:56:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b03de78-410f-487b-be1c-f8f98ea70c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b72bc593-909b-48b0-95e9-8e1b1debc711', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c907217-15bb-459a-8123-443e81cb3533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:18 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Volume volume-b72bc593-909b-48b0-95e9-8e1b1debc711 (b72bc593-909b-48b0-95e9-8e1b1debc711): created successfully
Sep 09 03:56:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c907217-15bb-459a-8123-443e81cb3533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Flow 'volume_create_manager' (793a3f0c-1865-4275-b770-6131170350ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:56:18 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7562d190-b28d-489b-8290-85416c9aff32 tempest-SnapshotMetadataTestJSON-847564519 None] Created volume successfully.
Sep 09 03:56:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:56:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] Creating offline snapshot 9ba32264-84aa-4d3b-8240-e7ddd7351f54 of volume b72bc593-909b-48b0-95e9-8e1b1debc711 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:56:20 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84da133-a947-47f8-ba54-13b3f0fca687]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:56:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:20 devstack sudo[95901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711
Sep 09 03:56:20 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:21 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711" returned: 0 in 0.972s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:21 devstack sudo[95907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54 1G
Sep 09 03:56:21 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:22 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54 1G" returned: 0 in 1.017s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b72bc593-909b-48b0-95e9-8e1b1debc711 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:22 devstack sudo[95948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b72bc593-909b-48b0-95e9-8e1b1debc711 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54
Sep 09 03:56:22 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:23 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b72bc593-909b-48b0-95e9-8e1b1debc711 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54" returned: 0 in 0.629s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:23 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54 is being set with open permissions: ugo+rw
Sep 09 03:56:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:23 devstack sudo[95956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54
Sep 09 03:56:23 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:23 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54" returned: 0 in 0.321s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:23 devstack sudo[95959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.info
Sep 09 03:56:23 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:23 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.info" returned: 0 in 0.411s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:23 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.info is being set with open permissions: ugo+rw
Sep 09 03:56:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:23 devstack sudo[95962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.info
Sep 09 03:56:23 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:24 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.info" returned: 0 in 0.361s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.894s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:56:24 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-13c4d425-2045-4d76-b27b-6a53d0b0605b tempest-SnapshotMetadataTestJSON-847564519 None] Create snapshot completed successfully
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Acquiring lock "cinder-9ba32264-84aa-4d3b-8240-e7ddd7351f54-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Lock "cinder-9ba32264-84aa-4d3b-8240-e7ddd7351f54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Acquiring lock "cinder-quobyte-b72bc593-909b-48b0-95e9-8e1b1debc711" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Lock "cinder-quobyte-b72bc593-909b-48b0-95e9-8e1b1debc711" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Acquiring lock "cinder-quobyte-9ba32264-84aa-4d3b-8240-e7ddd7351f54" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Lock "cinder-quobyte-9ba32264-84aa-4d3b-8240-e7ddd7351f54" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Deleting offline snapshot 9ba32264-84aa-4d3b-8240-e7ddd7351f54 of volume b72bc593-909b-48b0-95e9-8e1b1debc711 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] snapshot_file for this snap is: volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1040c889-345e-474a-bee3-6f98326cdc89]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:56:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:26 devstack sudo[95993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54
Sep 09 03:56:27 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:27 devstack sudo[95994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:56:27 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:27 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.637s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:56:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:56:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 03:56:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 03:56:27 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54" returned: 0 in 0.874s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b72bc593-909b-48b0-95e9-8e1b1debc711(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:56:27 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[97041d11-d308-4f70-ac35-397625772478]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:56:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:27 devstack sudo[96002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711
Sep 09 03:56:27 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:28 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711" returned: 0 in 0.457s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:28 devstack sudo[96008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54
Sep 09 03:56:28 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Flow 'volume_create_manager' (2bc608c0-073b-462b-8a20-84b0a5c3a150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c93e6b-b07a-432f-a732-ee2f1fe583eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c93e6b-b07a-432f-a732-ee2f1fe583eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-690293811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4f0a7c5-63ca-44c7-938c-7f6c15594894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb8026ac6164298bff85f8232620113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:28Z,use_quota=True,user_id='e1e4107b490749debf7c5ad473e6324b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07943062-afbc-4191-bf27-a1603ee5b3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07943062-afbc-4191-bf27-a1603ee5b3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82ff651-6bda-413f-8ed5-8ccd4d1220d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82ff651-6bda-413f-8ed5-8ccd4d1220d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4f0a7c5-63ca-44c7-938c-7f6c15594894', 'volume_name': 'volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ab2ed5-dc4f-4d70-ab5c-360b10514660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ab2ed5-dc4f-4d70-ab5c-360b10514660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c86242-3bff-49c5-afa8-d697fa054d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:28 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Volume f4f0a7c5-63ca-44c7-938c-7f6c15594894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894', 'volume_size': 1}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-690293811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4f0a7c5-63ca-44c7-938c-7f6c15594894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb8026ac6164298bff85f8232620113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:28Z,use_quota=True,user_id='e1e4107b490749debf7c5ad473e6324b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Creating volume f4f0a7c5-63ca-44c7-938c-7f6c15594894 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:56:28 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:28 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54" returned: 0 in 0.606s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:28 devstack sudo[96013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894 1073741824
Sep 09 03:56:28 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:28 devstack sudo[96014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54
Sep 09 03:56:28 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Acquiring lock "cinder-c2559717-c956-4fd7-82c9-b64d2dd3d7a8-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Lock "cinder-c2559717-c956-4fd7-82c9-b64d2dd3d7a8-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:56:29 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711.9ba32264-84aa-4d3b-8240-e7ddd7351f54" returned: 0 in 0.411s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Acquiring lock "cinder-quobyte-c2559717-c956-4fd7-82c9-b64d2dd3d7a8" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Lock "cinder-quobyte-9ba32264-84aa-4d3b-8240-e7ddd7351f54" released by "_delete_snapshot" :: held 2.584s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Lock "cinder-quobyte-b72bc593-909b-48b0-95e9-8e1b1debc711" released by "delete_snapshot" :: held 2.631s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Lock "cinder-quobyte-c2559717-c956-4fd7-82c9-b64d2dd3d7a8" acquired by "delete_volume" :: waited 0.045s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1380c836-6438-42d6-ab83-0382a808b601]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Created reservations ['8c6841b7-ece9-4288-8ef4-6faa10681ee4', '5279e4fe-32a0-49e3-a50e-99c520af606e', '94a44684-787f-4ad5-935e-67350969fcdd', 'dc4c0c11-9eb7-4aeb-900b-7a730f8d5bfd'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:56:29 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Delete snapshot completed successfully.
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-222f7f67-6c43-40b1-90f6-ad9da56e619b tempest-SnapshotMetadataTestJSON-847564519 None] Lock "cinder-9ba32264-84aa-4d3b-8240-e7ddd7351f54-delete_snapshot" released by "delete_snapshot" :: held 2.948s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:56:29 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894 1073741824" returned: 0 in 0.815s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:29 devstack sudo[96022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8
Sep 09 03:56:29 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:29 devstack sudo[96024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894
Sep 09 03:56:29 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:29 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894" returned: 0 in 0.331s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c86242-3bff-49c5-afa8-d697fa054d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1dc5a2-be10-4506-8f0a-d30423d090e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:29 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8" returned: 0 in 0.633s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:29 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Volume volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894 (f4f0a7c5-63ca-44c7-938c-7f6c15594894): created successfully
Sep 09 03:56:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1dc5a2-be10-4506-8f0a-d30423d090e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:30 devstack sudo[96031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Flow 'volume_create_manager' (2bc608c0-073b-462b-8a20-84b0a5c3a150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:56:30 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Acquiring lock "cinder-b72bc593-909b-48b0-95e9-8e1b1debc711-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:56:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d3a9a17c-03fe-4bb5-b0b4-61db1d48203e tempest-TestImageHashVerification-744641393 None] Created volume successfully.
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Lock "cinder-b72bc593-909b-48b0-95e9-8e1b1debc711-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Acquiring lock "cinder-quobyte-b72bc593-909b-48b0-95e9-8e1b1debc711" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Lock "cinder-quobyte-b72bc593-909b-48b0-95e9-8e1b1debc711" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faea8d7-5061-4bd1-8f2a-e84fb466dc46]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:56:30 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Flow 'volume_create_manager' (81eb8576-2624-4bd6-8589-1b45c58008e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c75946a-2067-4db3-a344-221deac1cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c2559717-c956-4fd7-82c9-b64d2dd3d7a8" returned: 0 in 0.404s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Lock "cinder-quobyte-c2559717-c956-4fd7-82c9-b64d2dd3d7a8" released by "delete_volume" :: held 1.101s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c75946a-2067-4db3-a344-221deac1cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2058808254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4ace92-3807-4135-9452-ac65fdd8073a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24fa0b04f73540c5955fcc3adea20d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:30Z,use_quota=True,user_id='f6f6f41728a6463b906a5088e43df5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:30 devstack sudo[96033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711
Sep 09 03:56:30 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54960d89-3b59-4683-abca-8f7ba8eac1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54960d89-3b59-4683-abca-8f7ba8eac1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e93bf7f-af10-46ec-995a-a2de7545f447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.image.glance [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Creating Keystone auth plugin from conf {{(pid=87558) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Created reservations ['9a8095a4-d897-49bb-812e-9b0ca322378d', '64e5619b-54ac-4b6a-b381-483f83832fd8', '30448ede-d9b1-4153-ade1-ff574b8b10c4', 'b1815be8-3268-4af8-8b57-b93e4c5b6299'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:30 devstack sudo[96037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:56:30 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:30 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711" returned: 0 in 0.513s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:30 devstack sudo[96041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711
Sep 09 03:56:30 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e93bf7f-af10-46ec-995a-a2de7545f447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e4ace92-3807-4135-9452-ac65fdd8073a', 'volume_name': 'volume-1e4ace92-3807-4135-9452-ac65fdd8073a', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c0374290>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df62811-1535-4fba-b3f2-e8c2a4a70e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df62811-1535-4fba-b3f2-e8c2a4a70e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:31 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c09809-5f80-4d40-8b05-e8da0a65aafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:31 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Volume 1e4ace92-3807-4135-9452-ac65fdd8073a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e4ace92-3807-4135-9452-ac65fdd8073a', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c0374290>}
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Trying to clone 1e4ace92-3807-4135-9452-ac65fdd8073a from image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]). {{(pid=87558) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.486s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:56:31 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Deleted volume successfully.
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7adf8665-f6a0-4263-9892-f388e1ceec91 tempest-ServerRescueNegativeTestJSON-473491782 None] Lock "cinder-c2559717-c956-4fd7-82c9-b64d2dd3d7a8-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:56:31 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b72bc593-909b-48b0-95e9-8e1b1debc711" returned: 0 in 0.434s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Lock "cinder-quobyte-b72bc593-909b-48b0-95e9-8e1b1debc711" released by "delete_volume" :: held 1.153s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Created reservations ['c162ff95-d5b8-41da-8562-3673c50151a8', 'f57e9356-952a-441f-b00e-8967a1ec7280', '402cf13f-4413-436c-9f2a-bea1bbe4a3e2', '560c1c28-8315-4c5e-8428-d40ef6b0a808'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 03:56:31 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Image download 20.69 MB at 20.69 MB/s
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:56:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:32 devstack sudo[96047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:56:32 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:32 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccafcb3d-697e-452e-907a-67f1bca4a187]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:56:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:32 devstack sudo[96051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD
Sep 09 03:56:32 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:32 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.692s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:32 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:56:32 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Deleted volume successfully.
Sep 09 03:56:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a10df3c5-748e-4bc2-85a3-92aec201b6e0 tempest-SnapshotMetadataTestJSON-847564519 None] Lock "cinder-b72bc593-909b-48b0-95e9-8e1b1debc711-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:56:32 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:32 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Temporary image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 is fetched for user f6f6f41728a6463b906a5088e43df5e9. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 03:56:33 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[341fa2b3-6829-4ff0-8470-5e5b17e98bae]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:56:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:56:33 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e98c679-4857-468d-8cda-88ad80b34d34]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:56:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:33 devstack sudo[96083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD
Sep 09 03:56:33 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:33 devstack sudo[96085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894
Sep 09 03:56:33 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:33 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:34 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894" returned: 0 in 1.113s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:34 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6c9415-0beb-45e9-aec8-61eaf1ecabfd]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:56:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:34 devstack sudo[96097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894
Sep 09 03:56:34 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:34 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894" returned: 0 in 0.434s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894 /opt/stack/data/cinder/conversion/f4f0a7c5-63ca-44c7-938c-7f6c15594894.temp_image.48710a14-b523-4086-a1cd-6740f141bc58u0pbk2xm.img {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:34 devstack sudo[96105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894 /opt/stack/data/cinder/conversion/f4f0a7c5-63ca-44c7-938c-7f6c15594894.temp_image.48710a14-b523-4086-a1cd-6740f141bc58u0pbk2xm.img
Sep 09 03:56:34 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:40 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894 /opt/stack/data/cinder/conversion/f4f0a7c5-63ca-44c7-938c-7f6c15594894.temp_image.48710a14-b523-4086-a1cd-6740f141bc58u0pbk2xm.img" returned: 0 in 6.135s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0961c599-d1d2-47f1-a5a7-a6b3b5405b48]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:56:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:56:41 devstack sudo[96144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894
Sep 09 03:56:41 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:56:41 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root
Sep 09 03:56:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894" returned: 0 in 0.592s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:56:41 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/conversion/f4f0a7c5-63ca-44c7-938c-7f6c15594894.temp_image.48710a14-b523-4086-a1cd-6740f141bc58u0pbk2xm.img {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 03:56:41 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] Converted 1024.00 MB image at 166.88 MB/s
Sep 09 03:56:41 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] 48710a14-b523-4086-a1cd-6740f141bc58 was raw, no need to convert to raw {{(pid=87558) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 09 03:56:41 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:56:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Flow 'volume_create_manager' (2c58b130-bc24-4a26-bad6-fbd7ef21f44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:56:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f55059-53ce-4220-ab96-4b8778a4aa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f55059-53ce-4220-ab96-4b8778a4aa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1836509132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477abe60-0796-44f7-b541-fe78cc3bb9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a59ddea2a54b449e3daec68a5e7bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:42Z,use_quota=True,user_id='078f2cee073241de8b2d4922b03fa68f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f77ddad-0ddd-4b25-9ef4-1f33718319a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f77ddad-0ddd-4b25-9ef4-1f33718319a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13c9344-a15a-4710-812a-e9fc016fd5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13c9344-a15a-4710-812a-e9fc016fd5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477abe60-0796-44f7-b541-fe78cc3bb9ab', 'volume_name': 'volume-477abe60-0796-44f7-b541-fe78cc3bb9ab', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b96c13-0c08-472c-bff3-dc675f3b42e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b96c13-0c08-472c-bff3-dc675f3b42e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:56:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d28d2d-115e-412e-a00d-ee4cd393eb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:56:42 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Volume 477abe60-0796-44f7-b541-fe78cc3bb9ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477abe60-0796-44f7-b541-fe78cc3bb9ab', 'volume_size': 1}
Sep 09 03:56:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:56:51 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=38,cinder:INSERT=15,cinder:UPDATE=43,cinder:DELETE=3 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:56:58 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=41,cinder:INSERT=10,cinder:UPDATE=55,cinder:DELETE=5 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.908s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] Uploaded volume to glance image-id: 48710a14-b523-4086-a1cd-6740f141bc58. {{(pid=87558) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.272s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2058808254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4ace92-3807-4135-9452-ac65fdd8073a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24fa0b04f73540c5955fcc3adea20d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:30Z,use_quota=True,user_id='f6f6f41728a6463b906a5088e43df5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Creating volume 1e4ace92-3807-4135-9452-ac65fdd8073a {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:57:03 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:03 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-32f1accb-537b-43ef-8f58-8e3aacda0944 tempest-TestImageHashVerification-744641393 None] Copy volume to image completed successfully.
Sep 09 03:57:03 devstack sudo[96210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a 1073741824
Sep 09 03:57:03 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:03 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a 1073741824" returned: 0 in 0.483s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:03 devstack sudo[96216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a
Sep 09 03:57:03 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:03 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a" returned: 0 in 0.284s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.911s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1836509132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477abe60-0796-44f7-b541-fe78cc3bb9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a59ddea2a54b449e3daec68a5e7bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:42Z,use_quota=True,user_id='078f2cee073241de8b2d4922b03fa68f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Creating volume 477abe60-0796-44f7-b541-fe78cc3bb9ab {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:57:03 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:57:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:03 devstack sudo[96219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab 1073741824
Sep 09 03:57:03 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:04 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Attempting download of 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}])) to volume 1e4ace92-3807-4135-9452-ac65fdd8073a. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 03:57:04 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c87fc5-3710-44db-9714-6ab140ad5419]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_jmtfrno5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:04 devstack sudo[96222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_jmtfrno5
Sep 09 03:57:04 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Acquiring lock "cinder-f4f0a7c5-63ca-44c7-938c-7f6c15594894-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Lock "cinder-f4f0a7c5-63ca-44c7-938c-7f6c15594894-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:04 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_jmtfrno5" returned: 0 in 0.551s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_jmtfrno5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:04 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab 1073741824" returned: 0 in 0.736s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Acquiring lock "cinder-quobyte-f4f0a7c5-63ca-44c7-938c-7f6c15594894" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Lock "cinder-quobyte-f4f0a7c5-63ca-44c7-938c-7f6c15594894" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:04 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee03500-cd49-4e8a-b5fb-c215f9107fa7]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:04 devstack sudo[96230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_jmtfrno5
Sep 09 03:57:04 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:04 devstack sudo[96234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab
Sep 09 03:57:04 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:04 devstack sudo[96233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894
Sep 09 03:57:04 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:05 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_jmtfrno5" returned: 1 in 0.412s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_jmtfrno5' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c565120-d8fc-4efb-941e-c3bf0d42a790]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:05 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab" returned: 0 in 0.376s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d28d2d-115e-412e-a00d-ee4cd393eb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477abe60-0796-44f7-b541-fe78cc3bb9ab', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:05 devstack sudo[96240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD
Sep 09 03:57:05 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6fcd94c-f6b1-4997-9137-875fb20ee140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:05 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Volume volume-477abe60-0796-44f7-b541-fe78cc3bb9ab (477abe60-0796-44f7-b541-fe78cc3bb9ab): created successfully
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6fcd94c-f6b1-4997-9137-875fb20ee140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Flow 'volume_create_manager' (2c58b130-bc24-4a26-bad6-fbd7ef21f44c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:05 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894" returned: 0 in 0.540s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:05 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-cb106c65-f943-4476-a9b4-d55667f39028 tempest-VolumesDeleteCascade-1416238834 None] Created volume successfully.
Sep 09 03:57:05 devstack sudo[96260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894
Sep 09 03:57:05 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:05 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 was qcow2, converting to qcow2 {{(pid=87558) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:05 devstack sudo[96310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a
Sep 09 03:57:05 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:05 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4f0a7c5-63ca-44c7-938c-7f6c15594894" returned: 0 in 0.573s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Lock "cinder-quobyte-f4f0a7c5-63ca-44c7-938c-7f6c15594894" released by "delete_volume" :: held 1.168s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Created reservations ['f8146899-0df7-4671-94f8-1d6c8f0a1137', '00295b9e-cba0-4119-a2fd-236aae4a0e57', '7ebcbc81-eaf1-400f-adfa-63b03b2cd3e9', '49ea3bed-f1cd-4939-99d5-d70574150193'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:06 devstack sudo[96318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:57:06 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] Creating offline snapshot db2c2d3f-f9ff-4afb-85a7-1edacdd62efc of volume 477abe60-0796-44f7-b541-fe78cc3bb9ab {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22e31e1-9910-431c-86c6-089f8dadf065]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:06 devstack sudo[96323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab
Sep 09 03:57:06 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:06 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.461s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:57:06 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Deleted volume successfully.
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2c4be2c-5a31-4b96-8662-4aafb6098268 tempest-TestImageHashVerification-744641393 None] Lock "cinder-f4f0a7c5-63ca-44c7-938c-7f6c15594894-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:06 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab" returned: 0 in 0.576s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:07 devstack sudo[96337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc 1G
Sep 09 03:57:07 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:07 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc 1G" returned: 0 in 0.599s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477abe60-0796-44f7-b541-fe78cc3bb9ab -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:07 devstack sudo[96343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477abe60-0796-44f7-b541-fe78cc3bb9ab -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc
Sep 09 03:57:07 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:08 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477abe60-0796-44f7-b541-fe78cc3bb9ab -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc" returned: 0 in 0.622s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:08 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc is being set with open permissions: ugo+rw
Sep 09 03:57:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:08 devstack sudo[96348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc
Sep 09 03:57:08 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:08 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc" returned: 0 in 0.386s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:08 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a" returned: 0 in 2.875s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:08 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_qo9u2b0fdevstack@QuobyteHD, size 112.00 MB, duration 2.88 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 03:57:08 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Converted 112.00 MB image at 38.92 MB/s
Sep 09 03:57:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:08 devstack sudo[96351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.info
Sep 09 03:57:08 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:08 devstack sudo[96353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a 1G
Sep 09 03:57:08 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:09 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.info" returned: 0 in 0.397s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:09 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.info is being set with open permissions: ugo+rw
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:09 devstack sudo[96359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.info
Sep 09 03:57:09 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:09 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a 1G" returned: 0 in 0.602s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Downloaded image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}])) to volume 1e4ace92-3807-4135-9452-ac65fdd8073a successfully. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Temporary image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 for user f6f6f41728a6463b906a5088e43df5e9 is deleted. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Marking volume 1e4ace92-3807-4135-9452-ac65fdd8073a as bootable. {{(pid=87558) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Copying metadata from image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 to 1e4ace92-3807-4135-9452-ac65fdd8073a. {{(pid=87558) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Creating volume glance metadata for volume 1e4ace92-3807-4135-9452-ac65fdd8073a backed by image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87558) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 03:57:09 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.info" returned: 0 in 0.471s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.221s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c09809-5f80-4d40-8b05-e8da0a65aafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e4ace92-3807-4135-9452-ac65fdd8073a', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c0374290>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e226f30-634a-462a-9808-dd200f9ed95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:09 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ffe6ca1f-d8c9-4a5f-bb7b-eada6837bf5f tempest-VolumesDeleteCascade-1416238834 None] Create snapshot completed successfully
Sep 09 03:57:09 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Volume volume-1e4ace92-3807-4135-9452-ac65fdd8073a (1e4ace92-3807-4135-9452-ac65fdd8073a): created successfully
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e226f30-634a-462a-9808-dd200f9ed95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Flow 'volume_create_manager' (81eb8576-2624-4bd6-8589-1b45c58008e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:09 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f33cbb09-3e82-4f7d-a6a0-d00349af70a2 tempest-VolumesImageMetadata-870630842 None] Created volume successfully.
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Acquiring lock "cinder-1e4ace92-3807-4135-9452-ac65fdd8073a-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] Creating offline snapshot bebb1ff6-ebab-4924-98a0-590557b547ef of volume 477abe60-0796-44f7-b541-fe78cc3bb9ab {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Lock "cinder-1e4ace92-3807-4135-9452-ac65fdd8073a-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[468fee14-12ee-4c7e-a42b-076b5d76d65a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Acquiring lock "cinder-quobyte-1e4ace92-3807-4135-9452-ac65fdd8073a" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Lock "cinder-quobyte-1e4ace92-3807-4135-9452-ac65fdd8073a" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2df04d-fccf-4585-9dc1-0c613e5c1cfe]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:11 devstack sudo[96368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc
Sep 09 03:57:11 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:11 devstack sudo[96369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a
Sep 09 03:57:11 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:11 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc" returned: 0 in 0.469s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-477abe60-0796-44f7-b541-fe78cc3bb9ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:11 devstack sudo[96375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef 1G
Sep 09 03:57:11 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:11 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a" returned: 0 in 0.655s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:11 devstack sudo[96383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a
Sep 09 03:57:11 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:12 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef 1G" returned: 0 in 0.790s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:12 devstack sudo[96387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef
Sep 09 03:57:12 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:12 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1e4ace92-3807-4135-9452-ac65fdd8073a" returned: 0 in 0.693s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Lock "cinder-quobyte-1e4ace92-3807-4135-9452-ac65fdd8073a" released by "delete_volume" :: held 1.405s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:12 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Created reservations ['c2e3f1c8-dde3-49a6-8fe0-02c6517c57d7', '1795b0f9-3c7e-4860-8f9f-3906f7c3c547', '18595413-17d8-4e89-ab42-19a144e0d03b', 'e03e73b5-6399-4799-93e3-f45ae6f9f509'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:57:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:12 devstack sudo[96394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:57:12 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:12 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef" returned: 0 in 0.504s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:12 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef is being set with open permissions: ugo+rw
Sep 09 03:57:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:13 devstack sudo[96396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef
Sep 09 03:57:13 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:13 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.466s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:13 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:57:13 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Deleted volume successfully.
Sep 09 03:57:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8de9681b-b119-456b-a9c0-1a4776f019b7 tempest-VolumesImageMetadata-870630842 None] Lock "cinder-1e4ace92-3807-4135-9452-ac65fdd8073a-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:13 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef" returned: 0 in 0.691s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.688s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:13 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0506f8d3-5931-44d7-b649-fae0613f6628 tempest-VolumesDeleteCascade-1416238834 None] Create snapshot completed successfully
Sep 09 03:57:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-477abe60-0796-44f7-b541-fe78cc3bb9ab-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-477abe60-0796-44f7-b541-fe78cc3bb9ab-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Performing cascade delete. {{(pid=87558) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 09 03:57:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-bebb1ff6-ebab-4924-98a0-590557b547ef-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-bebb1ff6-ebab-4924-98a0-590557b547ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-quobyte-477abe60-0796-44f7-b541-fe78cc3bb9ab" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-477abe60-0796-44f7-b541-fe78cc3bb9ab" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-quobyte-bebb1ff6-ebab-4924-98a0-590557b547ef" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-bebb1ff6-ebab-4924-98a0-590557b547ef" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Deleting offline snapshot bebb1ff6-ebab-4924-98a0-590557b547ef of volume 477abe60-0796-44f7-b541-fe78cc3bb9ab {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:57:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] snapshot_file for this snap is: volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:57:14 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b4e0d1-0cd0-4163-b5e5-31747f9e3d09]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:15 devstack sudo[96418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef
Sep 09 03:57:15 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:15 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef" returned: 0 in 0.536s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:15 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-477abe60-0796-44f7-b541-fe78cc3bb9ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:57:15 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[74258438-fd27-4dfd-b597-abab94e9dbca]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:15 devstack sudo[96425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc
Sep 09 03:57:15 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:15 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc" returned: 0 in 0.490s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:15 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-477abe60-0796-44f7-b541-fe78cc3bb9ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:57:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:16 devstack sudo[96431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef
Sep 09 03:57:16 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:16 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef" returned: 0 in 0.531s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:16 devstack sudo[96437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef
Sep 09 03:57:16 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:16 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.bebb1ff6-ebab-4924-98a0-590557b547ef" returned: 0 in 0.461s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-bebb1ff6-ebab-4924-98a0-590557b547ef" released by "_delete_snapshot" :: held 2.145s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-477abe60-0796-44f7-b541-fe78cc3bb9ab" released by "delete_snapshot" :: held 2.192s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Created reservations ['159ddef6-f381-4d2b-96fa-bfdeb5e3935e', 'beed24df-4421-46a3-bbb5-7ee6977683f1', '9f55d71d-5ba8-4e1a-8acd-570e678f74bd', '4d3a9a47-fcaf-49e1-99ea-0745ecbe149e'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:57:17 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Delete snapshot completed successfully.
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-bebb1ff6-ebab-4924-98a0-590557b547ef-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-db2c2d3f-f9ff-4afb-85a7-1edacdd62efc-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-db2c2d3f-f9ff-4afb-85a7-1edacdd62efc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-quobyte-477abe60-0796-44f7-b541-fe78cc3bb9ab" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-477abe60-0796-44f7-b541-fe78cc3bb9ab" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-quobyte-db2c2d3f-f9ff-4afb-85a7-1edacdd62efc" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-db2c2d3f-f9ff-4afb-85a7-1edacdd62efc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Deleting offline snapshot db2c2d3f-f9ff-4afb-85a7-1edacdd62efc of volume 477abe60-0796-44f7-b541-fe78cc3bb9ab {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] snapshot_file for this snap is: volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c9788a-a48b-4faf-8fa8-9f7c3473aeb3]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:17 devstack sudo[96441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc
Sep 09 03:57:17 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:17 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc" returned: 0 in 0.652s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-477abe60-0796-44f7-b541-fe78cc3bb9ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:57:18 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[21267761-1036-4ca5-9cc5-ac36b967c08c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:18 devstack sudo[96447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab
Sep 09 03:57:18 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:18 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab" returned: 0 in 0.720s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:18 devstack sudo[96455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc
Sep 09 03:57:18 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:19 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc" returned: 0 in 1.130s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:19 devstack sudo[96531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc
Sep 09 03:57:19 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:20 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab.db2c2d3f-f9ff-4afb-85a7-1edacdd62efc" returned: 0 in 0.471s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-db2c2d3f-f9ff-4afb-85a7-1edacdd62efc" released by "_delete_snapshot" :: held 3.157s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-477abe60-0796-44f7-b541-fe78cc3bb9ab" released by "delete_snapshot" :: held 3.185s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:20 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Created reservations ['6e68ddf8-6f6a-481a-a439-a018f63ab9a7', '25e8491d-7f60-42e1-91df-8bcb19a5fa8f', 'cc434395-7b7c-4a73-85c6-18da8c28795e', 'c9d10384-21f2-408d-a2c5-df4b63ac9881'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:57:20 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Delete snapshot completed successfully.
Sep 09 03:57:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-db2c2d3f-f9ff-4afb-85a7-1edacdd62efc-delete_snapshot" released by "delete_snapshot" :: held 3.484s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Snapshots deleted, issuing volume delete {{(pid=87558) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 09 03:57:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-quobyte-477abe60-0796-44f7-b541-fe78cc3bb9ab" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-477abe60-0796-44f7-b541-fe78cc3bb9ab" acquired by "delete_volume" :: waited 0.028s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:20 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b346e2-c9a6-4d26-9d45-a3de3c36c03b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:20 devstack sudo[96534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab
Sep 09 03:57:20 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:21 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab" returned: 0 in 0.612s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:21 devstack sudo[96543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab
Sep 09 03:57:21 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:21 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-477abe60-0796-44f7-b541-fe78cc3bb9ab" returned: 0 in 0.418s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-477abe60-0796-44f7-b541-fe78cc3bb9ab" released by "delete_volume" :: held 1.126s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:21 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Created reservations ['804c9a22-d15b-461a-ad13-891460f4311b', 'b7396df2-f911-454e-adc6-db65bcadc54d', '7755c934-7d1a-42f0-b2ab-e3cb9d3570e2', '21cdefeb-5586-479e-80bf-e152ce1081b6'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:57:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:22 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:22 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:22 devstack sudo[96546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:57:22 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:22 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.372s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:22 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:57:22 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Deleted volume successfully.
Sep 09 03:57:22 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eafca6b0-789b-4c99-a703-b339081743d2 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-477abe60-0796-44f7-b541-fe78cc3bb9ab-delete_volume" released by "delete_volume" :: held 7.987s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Flow 'volume_create_manager' (11eb4c18-2c62-4aa6-a6db-5e21dc8b702f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0a5ac1-a66c-4ffd-816b-929f3e6c84e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0a5ac1-a66c-4ffd-816b-929f3e6c84e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-492240177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9393dc62-09ed-452f-b9d7-a3d050048971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a59ddea2a54b449e3daec68a5e7bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:24Z,use_quota=True,user_id='078f2cee073241de8b2d4922b03fa68f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6845b82-1fdd-48e8-a3e5-5f4d48f39283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6845b82-1fdd-48e8-a3e5-5f4d48f39283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f310e2-d695-4ee2-ac66-3cbc8d355e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f310e2-d695-4ee2-ac66-3cbc8d355e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9393dc62-09ed-452f-b9d7-a3d050048971', 'volume_name': 'volume-9393dc62-09ed-452f-b9d7-a3d050048971', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78b1dcf-d111-45db-b2bb-1c863dddf784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78b1dcf-d111-45db-b2bb-1c863dddf784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6128fb1-8971-4492-9601-91ffb0f9320e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:24 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Volume 9393dc62-09ed-452f-b9d7-a3d050048971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9393dc62-09ed-452f-b9d7-a3d050048971', 'volume_size': 1}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-492240177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9393dc62-09ed-452f-b9d7-a3d050048971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a59ddea2a54b449e3daec68a5e7bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:24Z,use_quota=True,user_id='078f2cee073241de8b2d4922b03fa68f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Creating volume 9393dc62-09ed-452f-b9d7-a3d050048971 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:57:24 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:57:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:24 devstack sudo[96556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971 1073741824
Sep 09 03:57:24 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:25 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971 1073741824" returned: 0 in 0.807s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:25 devstack sudo[96587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971
Sep 09 03:57:25 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:25 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971" returned: 0 in 0.360s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:57:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6128fb1-8971-4492-9601-91ffb0f9320e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9393dc62-09ed-452f-b9d7-a3d050048971', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afb1cb4-d310-4a54-b948-834d780a2a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:25 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Volume volume-9393dc62-09ed-452f-b9d7-a3d050048971 (9393dc62-09ed-452f-b9d7-a3d050048971): created successfully
Sep 09 03:57:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afb1cb4-d310-4a54-b948-834d780a2a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Flow 'volume_create_manager' (11eb4c18-2c62-4aa6-a6db-5e21dc8b702f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-52125951-8ae7-49cc-858f-60cf902e9408 tempest-VolumesDeleteCascade-1416238834 None] Created volume successfully.
Sep 09 03:57:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] Creating offline snapshot b55b62d1-870b-4d1d-b5ea-2e48e3769866 of volume 9393dc62-09ed-452f-b9d7-a3d050048971 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:57:26 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[a058527d-3321-4b2d-9901-c4d2ada365fc]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:26 devstack sudo[96594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971
Sep 09 03:57:26 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:57:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:27 devstack sudo[96596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:57:27 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:27 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971" returned: 0 in 0.413s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:27 devstack sudo[96601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866 1G
Sep 09 03:57:27 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:27 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.449s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:57:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:57:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 03:57:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 03:57:27 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866 1G" returned: 0 in 0.657s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9393dc62-09ed-452f-b9d7-a3d050048971 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:27 devstack sudo[96607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9393dc62-09ed-452f-b9d7-a3d050048971 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866
Sep 09 03:57:27 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:28 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9393dc62-09ed-452f-b9d7-a3d050048971 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866" returned: 0 in 0.548s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:28 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866 is being set with open permissions: ugo+rw
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:28 devstack sudo[96612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866
Sep 09 03:57:28 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Flow 'volume_create_manager' (ea0dfb88-7bab-404d-8149-d350fd34c237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7718634-dab3-4fc6-802d-6b0eb0c4053e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7718634-dab3-4fc6-802d-6b0eb0c4053e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-235735444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbbbaf31-d9bb-4727-83db-af9de6b8aef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d80745223af4c289fd4551b583a653a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:29Z,use_quota=True,user_id='d5b5f1356e6844afb2ee7a238f93afc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb41f902-b576-4e57-8877-b874f475f81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb41f902-b576-4e57-8877-b874f475f81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2dab05-8ef1-4c58-ac19-8637744a9b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2dab05-8ef1-4c58-ac19-8637744a9b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbbbaf31-d9bb-4727-83db-af9de6b8aef0', 'volume_name': 'volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65187bc3-98ef-474b-ab9b-282d3843a6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65187bc3-98ef-474b-ab9b-282d3843a6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05302bf3-071f-45f6-b8f9-5a18c6161aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:28 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Volume cbbbaf31-d9bb-4727-83db-af9de6b8aef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0', 'volume_size': 1}
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:28 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866" returned: 0 in 0.531s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:28 devstack sudo[96615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.info
Sep 09 03:57:28 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Flow 'volume_create_manager' (63e7fbba-b42c-476c-9d0e-ed85eeb03f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e9f4a6-f21c-4e94-bcbb-e0a494d85204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e9f4a6-f21c-4e94-bcbb-e0a494d85204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1589655463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5901aa-0522-4e19-8231-ef17c5c52e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1107ce58fc9341fe852bba90988b3be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:29Z,use_quota=True,user_id='f77d6cd21ef64c2198d15f050143392b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e86592e-bcd0-4467-9656-e48d40598bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e86592e-bcd0-4467-9656-e48d40598bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62b1289-fdb5-4144-b539-3f5e0ca7dbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:29 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62b1289-fdb5-4144-b539-3f5e0ca7dbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5901aa-0522-4e19-8231-ef17c5c52e31', 'volume_name': 'volume-0b5901aa-0522-4e19-8231-ef17c5c52e31', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdf433c-2497-44b6-a24c-6da4e15bb7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdf433c-2497-44b6-a24c-6da4e15bb7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035bb213-df67-4dac-88ab-94f3bb31eee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:29 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Volume 0b5901aa-0522-4e19-8231-ef17c5c52e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5901aa-0522-4e19-8231-ef17c5c52e31', 'volume_size': 1}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.info" returned: 0 in 0.312s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:29 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.info is being set with open permissions: ugo+rw
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:29 devstack sudo[96618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.info
Sep 09 03:57:29 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:29 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.info" returned: 0 in 0.292s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.932s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-235735444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbbbaf31-d9bb-4727-83db-af9de6b8aef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d80745223af4c289fd4551b583a653a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:29Z,use_quota=True,user_id='d5b5f1356e6844afb2ee7a238f93afc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Creating volume cbbbaf31-d9bb-4727-83db-af9de6b8aef0 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:57:29 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:57:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:29 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-81c45395-e553-420a-9fd1-640fe32174b2 tempest-VolumesDeleteCascade-1416238834 None] Create snapshot completed successfully
Sep 09 03:57:29 devstack sudo[96621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0 1073741824
Sep 09 03:57:29 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:30 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0 1073741824" returned: 0 in 0.536s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:30 devstack sudo[96628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0
Sep 09 03:57:30 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:30 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0" returned: 0 in 0.387s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.314s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1589655463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5901aa-0522-4e19-8231-ef17c5c52e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1107ce58fc9341fe852bba90988b3be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:29Z,use_quota=True,user_id='f77d6cd21ef64c2198d15f050143392b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Creating volume 0b5901aa-0522-4e19-8231-ef17c5c52e31 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:57:30 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:57:30 devstack sudo[96631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 1073741824
Sep 09 03:57:30 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05302bf3-071f-45f6-b8f9-5a18c6161aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9828283c-4fdb-453b-9e75-90d299cc0c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Flow 'volume_create_manager' (48ee9c71-a523-42be-9d0a-dc52c1630eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1046eb25-b1c6-491a-81b5-c347ed13ee4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1046eb25-b1c6-491a-81b5-c347ed13ee4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-81604410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d4520b-6e47-4ff4-8a74-03f48e99c848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a59ddea2a54b449e3daec68a5e7bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b55b62d1-870b-4d1d-b5ea-2e48e3769866,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:30Z,use_quota=True,user_id='078f2cee073241de8b2d4922b03fa68f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9a4045-2fa0-4282-82e8-88d51612e40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9a4045-2fa0-4282-82e8-88d51612e40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc353f35-2f04-4b4e-9c48-e373b1bb9595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc353f35-2f04-4b4e-9c48-e373b1bb9595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '56d4520b-6e47-4ff4-8a74-03f48e99c848', 'volume_name': 'volume-56d4520b-6e47-4ff4-8a74-03f48e99c848', 'volume_size': 1, 'snapshot_id': 'b55b62d1-870b-4d1d-b5ea-2e48e3769866'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2c0046-7f97-468a-98f1-98ab7aac015d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2c0046-7f97-468a-98f1-98ab7aac015d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6934bd54-e0b7-4351-a79d-56c0cba572c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:30 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Volume 56d4520b-6e47-4ff4-8a74-03f48e99c848: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-56d4520b-6e47-4ff4-8a74-03f48e99c848', 'volume_size': 1, 'snapshot_id': 'b55b62d1-870b-4d1d-b5ea-2e48e3769866'}
Sep 09 03:57:30 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Volume volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0 (cbbbaf31-d9bb-4727-83db-af9de6b8aef0): created successfully
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9828283c-4fdb-453b-9e75-90d299cc0c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Flow 'volume_create_manager' (ea0dfb88-7bab-404d-8149-d350fd34c237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-57b16e3c-1c3e-4893-887a-e0fc13860974 tempest-ServersNegativeTestJSON-194675070 None] Created volume successfully.
Sep 09 03:57:31 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 1073741824" returned: 0 in 0.476s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:31 devstack sudo[96636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31
Sep 09 03:57:31 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:31 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31" returned: 0 in 0.255s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.525s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-quobyte-b55b62d1-870b-4d1d-b5ea-2e48e3769866-56d4520b-6e47-4ff4-8a74-03f48e99c848" by "_create_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035bb213-df67-4dac-88ab-94f3bb31eee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5901aa-0522-4e19-8231-ef17c5c52e31', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8277d5-3708-4e1e-accb-c96e57f4655c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-b55b62d1-870b-4d1d-b5ea-2e48e3769866-56d4520b-6e47-4ff4-8a74-03f48e99c848" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Creating volume 56d4520b-6e47-4ff4-8a74-03f48e99c848 from snapshot b55b62d1-870b-4d1d-b5ea-2e48e3769866 {{(pid=87558) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-quobyte-56d4520b-6e47-4ff4-8a74-03f48e99c848" by "_copy_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:31 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Volume volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 (0b5901aa-0522-4e19-8231-ef17c5c52e31): created successfully
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8277d5-3708-4e1e-accb-c96e57f4655c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Flow 'volume_create_manager' (63e7fbba-b42c-476c-9d0e-ed85eeb03f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-56d4520b-6e47-4ff4-8a74-03f48e99c848" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] snapshot: b55b62d1-870b-4d1d-b5ea-2e48e3769866, volume: 56d4520b-6e47-4ff4-8a74-03f48e99c848,  {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 03:57:31 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-dc4a1c3a-846a-429a-91c8-5b6cb1c76f4c tempest-VolumeDependencyTests-1445821935 None] Created volume successfully.
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[9222c5a9-ebcc-4ff0-b263-62fa9fa764bf]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:31 devstack sudo[96639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866
Sep 09 03:57:31 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:31 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866" returned: 0 in 0.422s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9393dc62-09ed-452f-b9d7-a3d050048971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e91d05f-c4f8-4c82-aefb-bd244898711e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:32 devstack sudo[96645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971
Sep 09 03:57:32 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:32 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971" returned: 0 in 0.431s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971 {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 03:57:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Creating direct copy from snapshot {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 03:57:32 devstack cinder-volume[87558]: DEBUG cinder.utils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Path /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848 not found in is_blk_device check {{(pid=87558) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 03:57:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:32 devstack sudo[96651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848
Sep 09 03:57:32 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:33 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:57:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Flow 'volume_create_manager' (ab755ea9-4f57-46a1-a16f-a2e98fe46f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334d3845-20ac-422c-b4eb-2086141a2bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334d3845-20ac-422c-b4eb-2086141a2bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-629908683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1b7c0b-2350-4c3d-9333-326810f73c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d80745223af4c289fd4551b583a653a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:34Z,use_quota=True,user_id='d5b5f1356e6844afb2ee7a238f93afc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092e4237-dcf4-4879-a5b8-fc43eda8c295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092e4237-dcf4-4879-a5b8-fc43eda8c295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac62367e-7b20-4b18-9239-dab7c8de3126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac62367e-7b20-4b18-9239-dab7c8de3126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd1b7c0b-2350-4c3d-9333-326810f73c9d', 'volume_name': 'volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff80d2d0-4d9f-4712-96e4-b4842f8ab012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff80d2d0-4d9f-4712-96e4-b4842f8ab012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d8406b-1826-4cd2-93d5-87268bb328bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:33 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Volume dd1b7c0b-2350-4c3d-9333-326810f73c9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d', 'volume_size': 1}
Sep 09 03:57:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:37 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848" returned: 0 in 5.435s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:37 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848 {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 03:57:37 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Converted 1024.00 MB image at 188.37 MB/s
Sep 09 03:57:37 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848 is being set with open permissions: ugo+rw
Sep 09 03:57:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:37 devstack sudo[96667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848
Sep 09 03:57:37 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:38 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848" returned: 0 in 0.271s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-56d4520b-6e47-4ff4-8a74-03f48e99c848" released by "_copy_volume_from_snapshot" :: held 6.669s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-b55b62d1-870b-4d1d-b5ea-2e48e3769866-56d4520b-6e47-4ff4-8a74-03f48e99c848" released by "_create_volume_from_snapshot" :: held 6.751s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.787s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.560s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] Creating offline snapshot 85c10ca9-d4ef-4097-ae9f-aed39cc5f998 of volume 0b5901aa-0522-4e19-8231-ef17c5c52e31 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6934bd54-e0b7-4351-a79d-56c0cba572c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d4520b-6e47-4ff4-8a74-03f48e99c848', 'volume_size': 1, 'snapshot_id': 'b55b62d1-870b-4d1d-b5ea-2e48e3769866'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa7055b-afd9-443f-a63d-e06be5416be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6506b132-24f4-40ed-8d15-affb3b9b8e18]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:38 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Volume volume-56d4520b-6e47-4ff4-8a74-03f48e99c848 (56d4520b-6e47-4ff4-8a74-03f48e99c848): created successfully
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa7055b-afd9-443f-a63d-e06be5416be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Flow 'volume_create_manager' (48ee9c71-a523-42be-9d0a-dc52c1630eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:38 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-1ec8ca12-25a6-458f-847a-b2839c07a48f tempest-VolumesDeleteCascade-1416238834 None] Created volume successfully.
Sep 09 03:57:38 devstack sudo[96670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31
Sep 09 03:57:38 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-9393dc62-09ed-452f-b9d7-a3d050048971-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-9393dc62-09ed-452f-b9d7-a3d050048971-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Performing cascade delete. {{(pid=87558) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-b55b62d1-870b-4d1d-b5ea-2e48e3769866-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-b55b62d1-870b-4d1d-b5ea-2e48e3769866-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:38 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-quobyte-9393dc62-09ed-452f-b9d7-a3d050048971" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31" returned: 0 in 0.515s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-9393dc62-09ed-452f-b9d7-a3d050048971" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-quobyte-b55b62d1-870b-4d1d-b5ea-2e48e3769866" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:38 devstack sudo[96675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998 1G
Sep 09 03:57:38 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-b55b62d1-870b-4d1d-b5ea-2e48e3769866" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Deleting offline snapshot b55b62d1-870b-4d1d-b5ea-2e48e3769866 of volume 9393dc62-09ed-452f-b9d7-a3d050048971 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] snapshot_file for this snap is: volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f9c7e9-d2ac-448a-8ec8-e16f675b2178]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:38 devstack sudo[96677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866
Sep 09 03:57:38 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:39 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998 1G" returned: 0 in 0.508s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:39 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866" returned: 0 in 0.444s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9393dc62-09ed-452f-b9d7-a3d050048971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:57:39 devstack sudo[96687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998
Sep 09 03:57:39 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:39 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc2575c-6731-4150-9e7a-a8bc565cfd00]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:39 devstack sudo[96689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971
Sep 09 03:57:39 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:39 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998" returned: 0 in 0.315s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:39 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998 is being set with open permissions: ugo+rw
Sep 09 03:57:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:39 devstack sudo[96694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998
Sep 09 03:57:39 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:39 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998" returned: 0 in 0.268s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:39 devstack sudo[96700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.info
Sep 09 03:57:39 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:39 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971" returned: 0 in 0.620s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:39 devstack sudo[96702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866
Sep 09 03:57:39 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:40 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.info" returned: 0 in 0.274s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:40 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.info is being set with open permissions: ugo+rw
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:40 devstack sudo[96707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.info
Sep 09 03:57:40 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:40 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866" returned: 0 in 0.428s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:40 devstack sudo[96710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866
Sep 09 03:57:40 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:40 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.info" returned: 0 in 0.390s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.576s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-629908683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1b7c0b-2350-4c3d-9333-326810f73c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d80745223af4c289fd4551b583a653a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:34Z,use_quota=True,user_id='d5b5f1356e6844afb2ee7a238f93afc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Creating volume dd1b7c0b-2350-4c3d-9333-326810f73c9d {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:57:40 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:40 devstack sudo[96714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d 1073741824
Sep 09 03:57:40 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:40 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-73513ad5-75cf-49ca-9f9c-3ea559307fd6 tempest-VolumeDependencyTests-1445821935 None] Create snapshot completed successfully
Sep 09 03:57:40 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971.b55b62d1-870b-4d1d-b5ea-2e48e3769866" returned: 0 in 0.337s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-b55b62d1-870b-4d1d-b5ea-2e48e3769866" released by "_delete_snapshot" :: held 1.941s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-9393dc62-09ed-452f-b9d7-a3d050048971" released by "delete_snapshot" :: held 1.971s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Created reservations ['b4d1b427-9949-4ebe-8306-3f16b39ea6b6', '8e43fd7a-fd03-4c26-8f75-b8171ad8cb7a', '27f78bc0-7654-4b75-961b-b8e994e4b8f6', 'd16a4b06-c676-4e95-a46e-6b1b5afb2c4f'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:57:40 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Delete snapshot completed successfully.
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-b55b62d1-870b-4d1d-b5ea-2e48e3769866-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Snapshots deleted, issuing volume delete {{(pid=87558) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-quobyte-9393dc62-09ed-452f-b9d7-a3d050048971" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-9393dc62-09ed-452f-b9d7-a3d050048971" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[319700f2-33d5-43e6-9f38-b7a8613974f0]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:41 devstack sudo[96719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971
Sep 09 03:57:41 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:41 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d 1073741824" returned: 0 in 0.724s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:41 devstack sudo[96724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d
Sep 09 03:57:41 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:41 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971" returned: 0 in 0.524s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:41 devstack sudo[96727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971
Sep 09 03:57:41 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:41 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d" returned: 0 in 0.371s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d8406b-1826-4cd2-93d5-87268bb328bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99427fb-a23c-4a24-a38e-1a0cee2a1ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:41 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9393dc62-09ed-452f-b9d7-a3d050048971" returned: 0 in 0.308s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:41 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Volume volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d (dd1b7c0b-2350-4c3d-9333-326810f73c9d): created successfully
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99427fb-a23c-4a24-a38e-1a0cee2a1ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Flow 'volume_create_manager' (ab755ea9-4f57-46a1-a16f-a2e98fe46f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-9393dc62-09ed-452f-b9d7-a3d050048971" released by "delete_volume" :: held 0.933s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:41 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-43ae014b-2d83-4fe6-9276-a325b3dc5518 tempest-ServersNegativeTestJSON-194675070 None] Created volume successfully.
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Created reservations ['fd7a8498-fba5-441e-8fca-6fc221f11cba', '90606b52-9366-4dc2-bd54-ec23483676e2', '5c542877-d74a-46c4-b7bc-94ce90a81155', 'ae694ea8-3440-413a-b32b-e207172f3992'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:57:41 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Flow 'volume_create_manager' (5c695dd1-056e-4ece-ad0c-dc4c31382fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f488d3a-6a0e-4ddb-b2bf-5571a1d67c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f488d3a-6a0e-4ddb-b2bf-5571a1d67c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1218989005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ceb6db-9b5d-410e-9d5d-587b59ff87fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1107ce58fc9341fe852bba90988b3be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=85c10ca9-d4ef-4097-ae9f-aed39cc5f998,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:42Z,use_quota=True,user_id='f77d6cd21ef64c2198d15f050143392b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab67403-d91e-42e2-9dfd-61b441953f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab67403-d91e-42e2-9dfd-61b441953f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9691de75-15c2-4fea-908c-d5511fdc618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9691de75-15c2-4fea-908c-d5511fdc618a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e5ceb6db-9b5d-410e-9d5d-587b59ff87fd', 'volume_name': 'volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd', 'volume_size': 1, 'snapshot_id': '85c10ca9-d4ef-4097-ae9f-aed39cc5f998'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15ac841-d373-47df-a022-710782a280fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15ac841-d373-47df-a022-710782a280fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9833f4-2ca1-478d-8d7a-4cf986fb6a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:42 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Volume e5ceb6db-9b5d-410e-9d5d-587b59ff87fd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd', 'volume_size': 1, 'snapshot_id': '85c10ca9-d4ef-4097-ae9f-aed39cc5f998'}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "cinder-quobyte-85c10ca9-d4ef-4097-ae9f-aed39cc5f998-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd" by "_create_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-quobyte-85c10ca9-d4ef-4097-ae9f-aed39cc5f998-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Creating volume e5ceb6db-9b5d-410e-9d5d-587b59ff87fd from snapshot 85c10ca9-d4ef-4097-ae9f-aed39cc5f998 {{(pid=87558) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:42 devstack sudo[96731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:57:42 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "cinder-quobyte-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd" by "_copy_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-quobyte-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] snapshot: 85c10ca9-d4ef-4097-ae9f-aed39cc5f998, volume: e5ceb6db-9b5d-410e-9d5d-587b59ff87fd,  {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db9c495-4f2e-4f47-b8b1-388941b2c3db]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:42 devstack sudo[96733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998
Sep 09 03:57:42 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:42 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.271s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:57:42 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Deleted volume successfully.
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-252adc31-3c14-4f68-a966-ed2caf82b4a4 tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-9393dc62-09ed-452f-b9d7-a3d050048971-delete_volume" released by "delete_volume" :: held 3.842s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:42 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998" returned: 0 in 0.464s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b5901aa-0522-4e19-8231-ef17c5c52e31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf2adbb-f122-4ea1-b0ca-f9ba63672db6]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:42 devstack sudo[96739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31
Sep 09 03:57:42 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Acquiring lock "cinder-dd1b7c0b-2350-4c3d-9333-326810f73c9d-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Lock "cinder-dd1b7c0b-2350-4c3d-9333-326810f73c9d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Acquiring lock "cinder-quobyte-dd1b7c0b-2350-4c3d-9333-326810f73c9d" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Lock "cinder-quobyte-dd1b7c0b-2350-4c3d-9333-326810f73c9d" acquired by "delete_volume" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35f5a8f-5926-4251-b31c-c22f251d346f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:43 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31" returned: 0 in 0.473s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Creating direct copy from snapshot {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.utils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Path /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd not found in is_blk_device check {{(pid=87558) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:43 devstack sudo[96745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd
Sep 09 03:57:43 devstack sudo[96743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d
Sep 09 03:57:43 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:43 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Flow 'volume_create_manager' (84f155a6-c4a6-4991-b533-40ace3858850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f41a5f-f1ca-476f-a905-2c191fd1b9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-56d4520b-6e47-4ff4-8a74-03f48e99c848-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f41a5f-f1ca-476f-a905-2c191fd1b9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1798026078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6b139e5b1245fcbb04192aff671f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:43Z,use_quota=True,user_id='d95cde00518a435e9f05dd7d032244aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7468bd-1633-4428-a0cb-689924b58384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7468bd-1633-4428-a0cb-689924b58384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7331a8-38ac-42aa-b6b1-7fc16c4d3805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7331a8-38ac-42aa-b6b1-7fc16c4d3805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4', 'volume_name': 'volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93af0617-13dd-4795-bf17-5bc720a3b5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93af0617-13dd-4795-bf17-5bc720a3b5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad87ebdc-38e9-417a-aa4a-09b3aee62f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:43 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Volume 99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4', 'volume_size': 1}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-56d4520b-6e47-4ff4-8a74-03f48e99c848-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "cinder-quobyte-56d4520b-6e47-4ff4-8a74-03f48e99c848" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-56d4520b-6e47-4ff4-8a74-03f48e99c848" acquired by "delete_volume" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a06159-a5ab-439f-bc1c-52a985ae7b19]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:43 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d" returned: 0 in 0.518s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:43 devstack sudo[96755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d
Sep 09 03:57:43 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:43 devstack sudo[96752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848
Sep 09 03:57:43 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:43 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-dd1b7c0b-2350-4c3d-9333-326810f73c9d" returned: 0 in 0.350s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Lock "cinder-quobyte-dd1b7c0b-2350-4c3d-9333-326810f73c9d" released by "delete_volume" :: held 0.953s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:44 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Created reservations ['6dced044-e2d9-492f-8cb3-220f9e2c0a30', 'bacab69d-0e66-4291-874c-d943fc2f0881', '335f047e-ac0b-4b63-ac3a-f4198dbc169a', '51495beb-f233-442f-b90f-b598edca726e'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:57:44 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848" returned: 0 in 0.815s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:44 devstack sudo[96769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:57:44 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:44 devstack sudo[96770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848
Sep 09 03:57:44 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:44 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.663s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:44 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:57:44 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Deleted volume successfully.
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-94c0656b-6ee4-4541-a7ee-076d458f841d tempest-ServersNegativeTestJSON-194675070 None] Lock "cinder-dd1b7c0b-2350-4c3d-9333-326810f73c9d-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:45 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-56d4520b-6e47-4ff4-8a74-03f48e99c848" returned: 0 in 1.080s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-quobyte-56d4520b-6e47-4ff4-8a74-03f48e99c848" released by "delete_volume" :: held 1.974s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Created reservations ['c0a8af0e-bdb1-4ab2-9ecb-9e89ff440172', '7f988b24-6602-42ce-b5f4-8f39a578f653', '5283e2f8-da79-415e-b451-013c104eab93', '0bb01d17-bc3e-4528-b858-e52c75d4a2c7'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Acquiring lock "cinder-cbbbaf31-d9bb-4727-83db-af9de6b8aef0-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Lock "cinder-cbbbaf31-d9bb-4727-83db-af9de6b8aef0-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:45 devstack sudo[96776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:57:45 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Acquiring lock "cinder-quobyte-cbbbaf31-d9bb-4727-83db-af9de6b8aef0" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Lock "cinder-quobyte-cbbbaf31-d9bb-4727-83db-af9de6b8aef0" acquired by "delete_volume" :: waited 0.084s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:46 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d4dc52-5a9a-4a25-b49a-9916d9c513ca]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:46 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.501s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:46 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:57:46 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Deleted volume successfully.
Sep 09 03:57:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fae66e1a-ef1d-4087-b7c5-51cfb2784ece tempest-VolumesDeleteCascade-1416238834 None] Lock "cinder-56d4520b-6e47-4ff4-8a74-03f48e99c848-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:46 devstack sudo[96778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0
Sep 09 03:57:46 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:46 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0" returned: 0 in 0.856s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:46 devstack sudo[96784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0
Sep 09 03:57:46 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:47 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbbbaf31-d9bb-4727-83db-af9de6b8aef0" returned: 0 in 0.891s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Lock "cinder-quobyte-cbbbaf31-d9bb-4727-83db-af9de6b8aef0" released by "delete_volume" :: held 1.891s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:47 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Created reservations ['358c3c0d-bfd8-4b55-b9db-5f2f8da193c7', '526ca93a-9c2e-452e-8494-8b4e2da7626c', '76749c77-cc8b-443c-9f07-add38a214b0b', '2ae18c18-bea6-412a-ae4b-da824f06647e'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:57:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:48 devstack sudo[96787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:57:48 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:48 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.643s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:48 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:57:48 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Deleted volume successfully.
Sep 09 03:57:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ebe48aa-8e0e-432a-9583-9e14bb44806d tempest-ServersNegativeTestJSON-194675070 None] Lock "cinder-cbbbaf31-d9bb-4727-83db-af9de6b8aef0-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:48 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd" returned: 0 in 5.684s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:48 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 03:57:48 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Converted 1024.00 MB image at 180.05 MB/s
Sep 09 03:57:48 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd is being set with open permissions: ugo+rw
Sep 09 03:57:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:48 devstack sudo[96794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd
Sep 09 03:57:48 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:49 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd" returned: 0 in 0.358s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-quobyte-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd" released by "_copy_volume_from_snapshot" :: held 7.087s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-quobyte-85c10ca9-d4ef-4097-ae9f-aed39cc5f998-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd" released by "_create_volume_from_snapshot" :: held 7.182s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.216s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.913s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1798026078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6b139e5b1245fcbb04192aff671f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:43Z,use_quota=True,user_id='d95cde00518a435e9f05dd7d032244aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Creating volume 99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:57:49 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:49 devstack sudo[96807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 1073741824
Sep 09 03:57:49 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9833f4-2ca1-478d-8d7a-4cf986fb6a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd', 'volume_size': 1, 'snapshot_id': '85c10ca9-d4ef-4097-ae9f-aed39cc5f998'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d5ff0f-41e9-483b-bcc8-5b5f01d5c5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:49 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Volume volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd (e5ceb6db-9b5d-410e-9d5d-587b59ff87fd): created successfully
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d5ff0f-41e9-483b-bcc8-5b5f01d5c5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Flow 'volume_create_manager' (5c695dd1-056e-4ece-ad0c-dc4c31382fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:49 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7c1b9e8d-50e8-442c-8a38-49999c7f8155 tempest-VolumeDependencyTests-1445821935 None] Created volume successfully.
Sep 09 03:57:50 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 1073741824" returned: 0 in 0.811s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "cinder-85c10ca9-d4ef-4097-ae9f-aed39cc5f998-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-85c10ca9-d4ef-4097-ae9f-aed39cc5f998-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "cinder-quobyte-0b5901aa-0522-4e19-8231-ef17c5c52e31" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:50 devstack sudo[96830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4
Sep 09 03:57:50 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-quobyte-0b5901aa-0522-4e19-8231-ef17c5c52e31" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "cinder-quobyte-85c10ca9-d4ef-4097-ae9f-aed39cc5f998" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-quobyte-85c10ca9-d4ef-4097-ae9f-aed39cc5f998" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Deleting offline snapshot 85c10ca9-d4ef-4097-ae9f-aed39cc5f998 of volume 0b5901aa-0522-4e19-8231-ef17c5c52e31 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] snapshot_file for this snap is: volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e2f4ce-a0a8-43b3-9a16-31dc7595ca6a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:50 devstack sudo[96832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998
Sep 09 03:57:50 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:50 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" returned: 0 in 0.375s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad87ebdc-38e9-417a-aa4a-09b3aee62f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606ee0e0-702f-443c-a17c-b6ad5340d55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:50 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Volume volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 (99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4): created successfully
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606ee0e0-702f-443c-a17c-b6ad5340d55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Flow 'volume_create_manager' (84f155a6-c4a6-4991-b533-40ace3858850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:50 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-94232ed8-1332-4069-892f-db096ab8000e tempest-VolumesActionsTest-746281324 None] Created volume successfully.
Sep 09 03:57:50 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998" returned: 0 in 0.506s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b5901aa-0522-4e19-8231-ef17c5c52e31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba38c07d-450f-4f8f-b77d-3540f684f37c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:51 devstack sudo[96839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31
Sep 09 03:57:51 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:51 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31" returned: 0 in 0.762s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:51 devstack sudo[96846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998
Sep 09 03:57:51 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:52 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998" returned: 0 in 0.481s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:52 devstack sudo[96851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998
Sep 09 03:57:52 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:52 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31.85c10ca9-d4ef-4097-ae9f-aed39cc5f998" returned: 0 in 0.392s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-quobyte-85c10ca9-d4ef-4097-ae9f-aed39cc5f998" released by "_delete_snapshot" :: held 2.302s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-quobyte-0b5901aa-0522-4e19-8231-ef17c5c52e31" released by "delete_snapshot" :: held 2.333s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:52 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Created reservations ['9636d42d-ce39-4d15-9c65-12b613f25f45', '93fe7bea-6ae8-4478-bb34-6a1ff512048f', '17c36d09-d410-4b27-a8f0-8972c2a6dbd1', 'f66a1da4-d03f-4e05-9c70-6412bd016fd8'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:57:52 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Delete snapshot completed successfully.
Sep 09 03:57:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a33e2874-72c2-462b-b71b-9bf0f9aa42c7 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-85c10ca9-d4ef-4097-ae9f-aed39cc5f998-delete_snapshot" released by "delete_snapshot" :: held 2.537s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "cinder-0b5901aa-0522-4e19-8231-ef17c5c52e31-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-0b5901aa-0522-4e19-8231-ef17c5c52e31-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "cinder-quobyte-0b5901aa-0522-4e19-8231-ef17c5c52e31" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-quobyte-0b5901aa-0522-4e19-8231-ef17c5c52e31" acquired by "delete_volume" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:53 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6101215-089a-4f87-8e5e-a4a164467b47]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:54 devstack sudo[96859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31
Sep 09 03:57:54 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:54 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31" returned: 0 in 0.589s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:54 devstack sudo[96866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31
Sep 09 03:57:54 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:54 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0b5901aa-0522-4e19-8231-ef17c5c52e31" returned: 0 in 0.433s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-quobyte-0b5901aa-0522-4e19-8231-ef17c5c52e31" released by "delete_volume" :: held 1.141s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:54 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Created reservations ['8c92148f-136d-4e79-9258-08dcdf49df9b', '6b5779be-4230-4e4c-b05f-0f2daa27d95b', '1d29e252-7cc8-4f0c-82da-c38b87780c0a', '2990c5c3-9a34-4aea-ae75-acd8d6ef4e87'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:55 devstack sudo[96883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:57:55 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Flow 'volume_create_manager' (d2d74aef-4d14-4648-a1c1-133c631e9f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1667d3d-2c76-45fe-ab53-ba1b84f9bfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1667d3d-2c76-45fe-ab53-ba1b84f9bfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-73732912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982c4376-744a-40b6-9309-938075901452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e822d25e100e403e8ce96cb7b68db868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:55Z,use_quota=True,user_id='76c800481a674088b56be51b7f4f7461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d16fe47-7b96-4464-8474-f7befaeeb0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d16fe47-7b96-4464-8474-f7befaeeb0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b680749-e578-40af-83d7-f529bd32b4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b680749-e578-40af-83d7-f529bd32b4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982c4376-744a-40b6-9309-938075901452', 'volume_name': 'volume-982c4376-744a-40b6-9309-938075901452', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9124b36-dbd6-4716-9a7c-596d6a4496a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9124b36-dbd6-4716-9a7c-596d6a4496a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07939b49-e27c-457c-91c0-996a0ad3daf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:55 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Volume 982c4376-744a-40b6-9309-938075901452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982c4376-744a-40b6-9309-938075901452', 'volume_size': 1}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-73732912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982c4376-744a-40b6-9309-938075901452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e822d25e100e403e8ce96cb7b68db868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:55Z,use_quota=True,user_id='76c800481a674088b56be51b7f4f7461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Creating volume 982c4376-744a-40b6-9309-938075901452 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:57:55 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982c4376-744a-40b6-9309-938075901452 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:55 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:55 devstack sudo[96889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982c4376-744a-40b6-9309-938075901452 1073741824
Sep 09 03:57:55 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.434s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:57:55 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Deleted volume successfully.
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-54187c4b-068b-4011-b5d3-36569a61ce7d tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-0b5901aa-0522-4e19-8231-ef17c5c52e31-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "cinder-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "cinder-quobyte-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:57:56 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-quobyte-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd" acquired by "delete_volume" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982c4376-744a-40b6-9309-938075901452 1073741824" returned: 0 in 0.610s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3253a87-4665-46a3-9a53-affc3b0ff094]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982c4376-744a-40b6-9309-938075901452 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:56 devstack sudo[96896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982c4376-744a-40b6-9309-938075901452
Sep 09 03:57:56 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:56 devstack sudo[96895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd
Sep 09 03:57:56 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:56 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982c4376-744a-40b6-9309-938075901452" returned: 0 in 0.339s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07939b49-e27c-457c-91c0-996a0ad3daf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982c4376-744a-40b6-9309-938075901452', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf92ac26-c0bb-497a-a5f6-7c2ff6e29c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:57:56 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Volume volume-982c4376-744a-40b6-9309-938075901452 (982c4376-744a-40b6-9309-938075901452): created successfully
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf92ac26-c0bb-497a-a5f6-7c2ff6e29c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Flow 'volume_create_manager' (d2d74aef-4d14-4648-a1c1-133c631e9f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:57:56 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd" returned: 0 in 0.471s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:56 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d4f42322-b741-4e24-9aed-cb95283bf4b5 tempest-VolumesTransfersTest-445720836 None] Created volume successfully.
Sep 09 03:57:56 devstack sudo[96903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd
Sep 09 03:57:56 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:56 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd" returned: 0 in 0.281s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-quobyte-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd" released by "delete_volume" :: held 0.805s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:56 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Created reservations ['89af5bcc-7c34-457c-a6b4-b0537b4bc34d', 'd2d964e3-5816-4a4a-80ac-4a88030f2748', '0a9431a8-2a72-499e-90f8-80b69029cf2c', '82f3dc8f-56ae-45e3-a79b-72ad4734e2f5'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:57:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:57:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:57:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:57:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:57:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:57:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:57:57 devstack sudo[96907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:57:57 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:57:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.451s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:57:57 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:57:57 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root
Sep 09 03:57:57 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Deleted volume successfully.
Sep 09 03:57:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4f1bf260-f28d-4632-a5c2-8068efb483d4 tempest-VolumeDependencyTests-1445821935 None] Lock "cinder-e5ceb6db-9b5d-410e-9d5d-587b59ff87fd-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:57:59 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=130,cinder:SELECT=107,cinder:INSERT=39,cinder:DELETE=15 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:57:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8e6ecdd8-0d43-424b-a0a1-dc5c6883a6ee tempest-VolumesTransfersTest-1768964008 None] Transfer volume completed successfully.
Sep 09 03:58:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Acquiring lock "cinder-982c4376-744a-40b6-9309-938075901452-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Lock "cinder-982c4376-744a-40b6-9309-938075901452-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Acquiring lock "cinder-quobyte-982c4376-744a-40b6-9309-938075901452" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Lock "cinder-quobyte-982c4376-744a-40b6-9309-938075901452" acquired by "delete_volume" :: waited 0.055s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:01 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16272c0-6598-4dc0-832d-d4eec35b9020]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982c4376-744a-40b6-9309-938075901452 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:01 devstack sudo[97015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982c4376-744a-40b6-9309-938075901452
Sep 09 03:58:01 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c783c9e8-3393-4dd4-b7de-8df093acc8c5 tempest-VolumesActionsTest-746281324 None] Acquiring lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" by "attach_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c783c9e8-3393-4dd4-b7de-8df093acc8c5 tempest-VolumesActionsTest-746281324 None] Lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" acquired by "attach_volume" :: waited 0.047s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:01 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:01 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c783c9e8-3393-4dd4-b7de-8df093acc8c5 tempest-VolumesActionsTest-746281324 None] Attaching volume 99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 to instance d2882bda-c192-4825-865a-77c738e6f91c at mountpoint /dev/vdb on host None.
Sep 09 03:58:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982c4376-744a-40b6-9309-938075901452" returned: 0 in 0.613s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982c4376-744a-40b6-9309-938075901452 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:01 devstack sudo[97020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982c4376-744a-40b6-9309-938075901452
Sep 09 03:58:01 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:01 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c783c9e8-3393-4dd4-b7de-8df093acc8c5 tempest-VolumesActionsTest-746281324 None] Attach volume completed successfully.
Sep 09 03:58:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c783c9e8-3393-4dd4-b7de-8df093acc8c5 tempest-VolumesActionsTest-746281324 None] Lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" released by "attach_volume" :: held 0.271s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-69f9a234-450c-42f2-96d8-f0f38f67d017 tempest-VolumesActionsTest-746281324 None] Acquiring lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4-detach_volume" by "detach_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-69f9a234-450c-42f2-96d8-f0f38f67d017 tempest-VolumesActionsTest-746281324 None] Lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:02 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-69f9a234-450c-42f2-96d8-f0f38f67d017 tempest-VolumesActionsTest-746281324 None] Detaching volume 99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 from instance d2882bda-c192-4825-865a-77c738e6f91c.
Sep 09 03:58:02 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=115,cinder:INSERT=39,cinder:UPDATE=131,cinder:DELETE=8 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:58:02 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-69f9a234-450c-42f2-96d8-f0f38f67d017 tempest-VolumesActionsTest-746281324 None] Detach volume completed successfully.
Sep 09 03:58:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-69f9a234-450c-42f2-96d8-f0f38f67d017 tempest-VolumesActionsTest-746281324 None] Lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4-detach_volume" released by "detach_volume" :: held 0.113s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:02 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-982c4376-744a-40b6-9309-938075901452" returned: 0 in 0.606s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Lock "cinder-quobyte-982c4376-744a-40b6-9309-938075901452" released by "delete_volume" :: held 1.318s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:02 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Created reservations ['6a69a1d5-a221-46b3-9fea-e91c0533da46', 'b5827c90-3b9d-427f-ad7c-ca7d69880bb1', '8587a1a7-75e1-4a6b-8cdd-c9402ce8ffdd', 'ac581866-8a64-4742-a74a-3812da673db7'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:58:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:02 devstack sudo[97025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:58:02 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:03 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.481s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:03 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:58:03 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Deleted volume successfully.
Sep 09 03:58:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-001f5dea-cbd4-4ebc-b367-d4ad00d814f0 tempest-VolumesTransfersTest-293796954 None] Lock "cinder-982c4376-744a-40b6-9309-938075901452-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Flow 'volume_create_manager' (649f6ec0-789d-4066-b12f-21e9d83ebf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321a80b0-17dc-4a52-a7cd-3f27becc500c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321a80b0-17dc-4a52-a7cd-3f27becc500c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-384881078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d75d718-b9a4-454d-8100-9de42a29217d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e822d25e100e403e8ce96cb7b68db868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:04Z,use_quota=True,user_id='76c800481a674088b56be51b7f4f7461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1b7753-eea9-4515-89db-8f2012cc1764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1b7753-eea9-4515-89db-8f2012cc1764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2d37d2-1457-49f6-9e36-5d55d1c623a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2d37d2-1457-49f6-9e36-5d55d1c623a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d75d718-b9a4-454d-8100-9de42a29217d', 'volume_name': 'volume-9d75d718-b9a4-454d-8100-9de42a29217d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7811b201-9387-4a61-a1eb-a88acc94a540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7811b201-9387-4a61-a1eb-a88acc94a540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525e5767-e02b-404d-b8fc-494a83ab3253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:04 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Volume 9d75d718-b9a4-454d-8100-9de42a29217d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d75d718-b9a4-454d-8100-9de42a29217d', 'volume_size': 1}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-384881078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d75d718-b9a4-454d-8100-9de42a29217d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e822d25e100e403e8ce96cb7b68db868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:04Z,use_quota=True,user_id='76c800481a674088b56be51b7f4f7461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Creating volume 9d75d718-b9a4-454d-8100-9de42a29217d {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:58:04 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:58:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9d75d718-b9a4-454d-8100-9de42a29217d 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:04 devstack sudo[97053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9d75d718-b9a4-454d-8100-9de42a29217d 1073741824
Sep 09 03:58:04 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:05 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9d75d718-b9a4-454d-8100-9de42a29217d 1073741824" returned: 0 in 0.643s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9d75d718-b9a4-454d-8100-9de42a29217d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:05 devstack sudo[97063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9d75d718-b9a4-454d-8100-9de42a29217d
Sep 09 03:58:05 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:05 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9d75d718-b9a4-454d-8100-9de42a29217d" returned: 0 in 0.291s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:58:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525e5767-e02b-404d-b8fc-494a83ab3253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d75d718-b9a4-454d-8100-9de42a29217d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82fb3835-d4db-492f-a6d3-e3a06640ea84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:05 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Volume volume-9d75d718-b9a4-454d-8100-9de42a29217d (9d75d718-b9a4-454d-8100-9de42a29217d): created successfully
Sep 09 03:58:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82fb3835-d4db-492f-a6d3-e3a06640ea84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Flow 'volume_create_manager' (649f6ec0-789d-4066-b12f-21e9d83ebf82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:05 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f3153851-74ca-4800-95e9-23770e5c9b3c tempest-VolumesTransfersTest-445720836 None] Created volume successfully.
Sep 09 03:58:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Acquiring lock "cinder-9d75d718-b9a4-454d-8100-9de42a29217d-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Lock "cinder-9d75d718-b9a4-454d-8100-9de42a29217d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Acquiring lock "cinder-quobyte-9d75d718-b9a4-454d-8100-9de42a29217d" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Lock "cinder-quobyte-9d75d718-b9a4-454d-8100-9de42a29217d" acquired by "delete_volume" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:06 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[69417dd6-16cf-48aa-bdbd-55b38f824086]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9d75d718-b9a4-454d-8100-9de42a29217d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:07 devstack sudo[97070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9d75d718-b9a4-454d-8100-9de42a29217d
Sep 09 03:58:07 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:07 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9d75d718-b9a4-454d-8100-9de42a29217d" returned: 0 in 0.461s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9d75d718-b9a4-454d-8100-9de42a29217d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:07 devstack sudo[97076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9d75d718-b9a4-454d-8100-9de42a29217d
Sep 09 03:58:07 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:07 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9d75d718-b9a4-454d-8100-9de42a29217d" returned: 0 in 0.347s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Lock "cinder-quobyte-9d75d718-b9a4-454d-8100-9de42a29217d" released by "delete_volume" :: held 0.868s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:07 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Created reservations ['63eee4bb-0ce6-40a3-8529-1bde974cce2b', '8c38f028-5b90-4a20-b368-d94ea1ec1583', '67ea9936-c865-4e72-b62a-5a57b661a72a', '9d54d381-1048-44c9-9b49-9b06bdba0ee2'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:58:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:07 devstack sudo[97080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:58:07 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:08 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.360s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:08 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:58:08 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Deleted volume successfully.
Sep 09 03:58:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fd15aac9-75cc-422b-a5fd-a370d678bbe2 tempest-VolumesTransfersTest-293796954 None] Lock "cinder-9d75d718-b9a4-454d-8100-9de42a29217d-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:08 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:58:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Flow 'volume_create_manager' (b00bae99-a377-4c2f-ac39-f2535ac1bcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b570724a-eef8-42a9-a802-03ae147237c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b570724a-eef8-42a9-a802-03ae147237c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77968c8f-5a38-4ddf-96c2-d56ae73d8d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='620815823e09417fb3582b565a993685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:08Z,use_quota=True,user_id='d728b74e490047649ce0bfadc8e86fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80286f21-fd99-448e-b155-1650f2fa55aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80286f21-fd99-448e-b155-1650f2fa55aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50967a91-c648-4308-bdd2-0412e27bdc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:08 devstack cinder-volume[87558]: DEBUG cinder.image.glance [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Creating Keystone auth plugin from conf {{(pid=87558) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 03:58:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50967a91-c648-4308-bdd2-0412e27bdc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77968c8f-5a38-4ddf-96c2-d56ae73d8d24', 'volume_name': 'volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24', 'volume_size': 1, 'image_id': '5620c1e3-b628-4464-a808-48e08727aaa2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5620c1e3-b628-4464-a808-48e08727aaa2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6fc44211c79bf197d176da0301907372', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '620815823e09417fb3582b565a993685', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3b02e98b2b50bb72318a5154c3fec1395cae75315cd150e5c71734bddf4de7bbf8f8b5e134bd387ac9867cf59b9eb7e89c9a9b0c08899121ac8400d45a484cd7', 'id': '5620c1e3-b628-4464-a808-48e08727aaa2', 'created_at': datetime.datetime(2026, 9, 9, 1, 58, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 58, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5620c1e3-b628-4464-a808-48e08727aaa2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c069b350>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d53e6e55-8617-4a3d-827b-62ec1b1074eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d53e6e55-8617-4a3d-827b-62ec1b1074eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d730e6a6-a85e-487b-b330-980b44c11e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:09 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Volume 77968c8f-5a38-4ddf-96c2-d56ae73d8d24: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24', 'volume_size': 1, 'image_id': '5620c1e3-b628-4464-a808-48e08727aaa2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5620c1e3-b628-4464-a808-48e08727aaa2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6fc44211c79bf197d176da0301907372', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '620815823e09417fb3582b565a993685', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3b02e98b2b50bb72318a5154c3fec1395cae75315cd150e5c71734bddf4de7bbf8f8b5e134bd387ac9867cf59b9eb7e89c9a9b0c08899121ac8400d45a484cd7', 'id': '5620c1e3-b628-4464-a808-48e08727aaa2', 'created_at': datetime.datetime(2026, 9, 9, 1, 58, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 58, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5620c1e3-b628-4464-a808-48e08727aaa2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c069b350>}
Sep 09 03:58:09 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Trying to clone 77968c8f-5a38-4ddf-96c2-d56ae73d8d24 from image 5620c1e3-b628-4464-a808-48e08727aaa2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5620c1e3-b628-4464-a808-48e08727aaa2', 'metadata': {}}]). {{(pid=87558) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 03:58:09 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 03:58:09 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Image download 0.00 MB at 0.00 MB/s
Sep 09 03:58:09 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[159c1ad6-5bf4-49a8-af87-2075aa0d2b26]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:09 devstack sudo[97099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD
Sep 09 03:58:09 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:10 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:10 devstack sudo[97103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD
Sep 09 03:58:10 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:10 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD" returned: 1 in 0.473s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 03:58:10 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Temporary image 5620c1e3-b628-4464-a808-48e08727aaa2 is fetched for user d728b74e490047649ce0bfadc8e86fa4. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 03:58:10 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37f580b-e25a-46a9-ac43-9429bba769cb]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:10 devstack sudo[97109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD
Sep 09 03:58:10 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:11 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:11 devstack sudo[97113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD
Sep 09 03:58:11 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:11 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD" returned: 1 in 0.395s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77968c8f-5a38-4ddf-96c2-d56ae73d8d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='620815823e09417fb3582b565a993685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:08Z,use_quota=True,user_id='d728b74e490047649ce0bfadc8e86fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Creating volume 77968c8f-5a38-4ddf-96c2-d56ae73d8d24 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:58:11 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:58:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:11 devstack sudo[97118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24 1073741824
Sep 09 03:58:11 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:12 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24 1073741824" returned: 0 in 0.622s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:12 devstack sudo[97126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24
Sep 09 03:58:12 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:12 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24" returned: 0 in 0.328s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:58:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:12 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Attempting download of 5620c1e3-b628-4464-a808-48e08727aaa2 ((None, [{'url': 'file:///opt/stack/data/glance/images/5620c1e3-b628-4464-a808-48e08727aaa2', 'metadata': {}}])) to volume 77968c8f-5a38-4ddf-96c2-d56ae73d8d24. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 03:58:12 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ca375e-3eef-4f61-a799-c7653d6fdb1d]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5620c1e3-b628-4464-a808-48e08727aaa2_js7uvame {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:12 devstack sudo[97129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5620c1e3-b628-4464-a808-48e08727aaa2_js7uvame
Sep 09 03:58:12 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:13 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5620c1e3-b628-4464-a808-48e08727aaa2_js7uvame" returned: 0 in 0.404s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5620c1e3-b628-4464-a808-48e08727aaa2_js7uvame {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:13 devstack sudo[97133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5620c1e3-b628-4464-a808-48e08727aaa2_js7uvame
Sep 09 03:58:13 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:13 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5620c1e3-b628-4464-a808-48e08727aaa2_js7uvame" returned: 1 in 0.395s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5620c1e3-b628-4464-a808-48e08727aaa2_js7uvame' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 03:58:13 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1583c5e5-5bf5-4979-9935-4f99d23b64e5]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:13 devstack sudo[97137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD
Sep 09 03:58:13 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:13 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:13 devstack sudo[97141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD
Sep 09 03:58:13 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:14 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD" returned: 1 in 0.431s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 03:58:14 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] 5620c1e3-b628-4464-a808-48e08727aaa2 was raw, converting to qcow2 {{(pid=87558) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 03:58:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:14 devstack sudo[97146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24
Sep 09 03:58:14 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:14 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24" returned: 0 in 0.677s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:14 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5620c1e3-b628-4464-a808-48e08727aaa2_s_xs1vomdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24 {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 03:58:14 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Converted 0.00 MB image at 0.00 MB/s
Sep 09 03:58:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:14 devstack sudo[97153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24 1G
Sep 09 03:58:14 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:15 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24 1G" returned: 0 in 0.384s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:15 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Downloaded image 5620c1e3-b628-4464-a808-48e08727aaa2 ((None, [{'url': 'file:///opt/stack/data/glance/images/5620c1e3-b628-4464-a808-48e08727aaa2', 'metadata': {}}])) to volume 77968c8f-5a38-4ddf-96c2-d56ae73d8d24 successfully. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 03:58:15 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Temporary image 5620c1e3-b628-4464-a808-48e08727aaa2 for user d728b74e490047649ce0bfadc8e86fa4 is deleted. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 03:58:15 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Marking volume 77968c8f-5a38-4ddf-96c2-d56ae73d8d24 as bootable. {{(pid=87558) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 03:58:15 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Copying metadata from image 5620c1e3-b628-4464-a808-48e08727aaa2 to 77968c8f-5a38-4ddf-96c2-d56ae73d8d24. {{(pid=87558) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 03:58:15 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Creating volume glance metadata for volume 77968c8f-5a38-4ddf-96c2-d56ae73d8d24 backed by image 5620c1e3-b628-4464-a808-48e08727aaa2 with: {'image_id': '5620c1e3-b628-4464-a808-48e08727aaa2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6fc44211c79bf197d176da0301907372', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87558) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 03:58:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d730e6a6-a85e-487b-b330-980b44c11e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24', 'volume_size': 1, 'image_id': '5620c1e3-b628-4464-a808-48e08727aaa2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5620c1e3-b628-4464-a808-48e08727aaa2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6fc44211c79bf197d176da0301907372', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '620815823e09417fb3582b565a993685', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3b02e98b2b50bb72318a5154c3fec1395cae75315cd150e5c71734bddf4de7bbf8f8b5e134bd387ac9867cf59b9eb7e89c9a9b0c08899121ac8400d45a484cd7', 'id': '5620c1e3-b628-4464-a808-48e08727aaa2', 'created_at': datetime.datetime(2026, 9, 9, 1, 58, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 58, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5620c1e3-b628-4464-a808-48e08727aaa2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c069b350>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd068dc8-9820-44f7-a806-5a4241696f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:15 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Volume volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24 (77968c8f-5a38-4ddf-96c2-d56ae73d8d24): created successfully
Sep 09 03:58:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd068dc8-9820-44f7-a806-5a4241696f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Flow 'volume_create_manager' (b00bae99-a377-4c2f-ac39-f2535ac1bcf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:15 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8e2a0ffe-5dab-4192-bc9d-027321958438 tempest-VolumeImageDependencyTests-760356345 None] Created volume successfully.
Sep 09 03:58:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Acquiring lock "cinder-77968c8f-5a38-4ddf-96c2-d56ae73d8d24-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Lock "cinder-77968c8f-5a38-4ddf-96c2-d56ae73d8d24-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Acquiring lock "cinder-quobyte-77968c8f-5a38-4ddf-96c2-d56ae73d8d24" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Lock "cinder-quobyte-77968c8f-5a38-4ddf-96c2-d56ae73d8d24" acquired by "delete_volume" :: waited 0.039s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:16 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d4a35a-1058-4fef-950e-828b96a72afc]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:16 devstack sudo[97217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24
Sep 09 03:58:16 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:17 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24" returned: 0 in 0.939s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:17 devstack sudo[97230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24
Sep 09 03:58:17 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:18 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-77968c8f-5a38-4ddf-96c2-d56ae73d8d24" returned: 0 in 0.459s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Lock "cinder-quobyte-77968c8f-5a38-4ddf-96c2-d56ae73d8d24" released by "delete_volume" :: held 1.535s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:18 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Created reservations ['fcf834b3-7e66-40e8-9973-9dd2c62a8cbb', 'ac361ac5-0066-48f2-ab91-5fd8ccb4e56b', 'ac437dbb-84ac-4e34-b3cb-63bb04391a21', '9d0a2235-f325-4364-84d3-2740449c5ee9'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:58:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:18 devstack sudo[97236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:58:18 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:19 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.675s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:19 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:58:19 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Deleted volume successfully.
Sep 09 03:58:19 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c51304c3-8017-4365-9cdb-7a648f597d00 tempest-VolumeImageDependencyTests-760356345 None] Lock "cinder-77968c8f-5a38-4ddf-96c2-d56ae73d8d24-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e9f1ad2b-6932-47aa-9a36-d090c08c332a tempest-VolumesActionsTest-746281324 None] Acquiring lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" by "attach_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e9f1ad2b-6932-47aa-9a36-d090c08c332a tempest-VolumesActionsTest-746281324 None] Lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" acquired by "attach_volume" :: waited 0.034s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:20 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e9f1ad2b-6932-47aa-9a36-d090c08c332a tempest-VolumesActionsTest-746281324 None] Attaching volume 99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 to instance c30f4635-5fb3-4124-b535-326b9f632c06 at mountpoint /dev/vdb on host None.
Sep 09 03:58:20 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e9f1ad2b-6932-47aa-9a36-d090c08c332a tempest-VolumesActionsTest-746281324 None] Attach volume completed successfully.
Sep 09 03:58:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e9f1ad2b-6932-47aa-9a36-d090c08c332a tempest-VolumesActionsTest-746281324 None] Lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" released by "attach_volume" :: held 0.133s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9a064f25-8249-439e-ba41-437fe8f53465 tempest-VolumesActionsTest-746281324 None] Acquiring lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4-detach_volume" by "detach_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9a064f25-8249-439e-ba41-437fe8f53465 tempest-VolumesActionsTest-746281324 None] Lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:21 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9a064f25-8249-439e-ba41-437fe8f53465 tempest-VolumesActionsTest-746281324 None] Detaching volume 99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 from instance c30f4635-5fb3-4124-b535-326b9f632c06.
Sep 09 03:58:21 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9a064f25-8249-439e-ba41-437fe8f53465 tempest-VolumesActionsTest-746281324 None] Detach volume completed successfully.
Sep 09 03:58:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9a064f25-8249-439e-ba41-437fe8f53465 tempest-VolumesActionsTest-746281324 None] Lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4-detach_volume" released by "detach_volume" :: held 0.127s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Flow 'volume_create_manager' (947ab342-b320-4cce-8249-db733b69571c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ca49e5-2d7a-401f-9d16-09d6651e0e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ca49e5-2d7a-401f-9d16-09d6651e0e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-330887945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d231442e-05ae-4327-8edf-91fdf2f8a66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8765bd733e4347b809e061d0cebcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:24Z,use_quota=True,user_id='1d6d5a4a429c4959bbbdf209b5ff4c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7515c5bb-c740-4961-8472-f0b64eab6ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7515c5bb-c740-4961-8472-f0b64eab6ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7435143-ebad-497a-81cc-d13226d99839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7435143-ebad-497a-81cc-d13226d99839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd231442e-05ae-4327-8edf-91fdf2f8a66b', 'volume_name': 'volume-d231442e-05ae-4327-8edf-91fdf2f8a66b', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c61e66e-62d1-4527-b2fa-36924553fa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c61e66e-62d1-4527-b2fa-36924553fa9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dd7e0b-a8f5-48d5-b636-ea453601f7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:23 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Volume d231442e-05ae-4327-8edf-91fdf2f8a66b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d231442e-05ae-4327-8edf-91fdf2f8a66b', 'volume_size': 1}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-330887945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d231442e-05ae-4327-8edf-91fdf2f8a66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8765bd733e4347b809e061d0cebcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:24Z,use_quota=True,user_id='1d6d5a4a429c4959bbbdf209b5ff4c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Creating volume d231442e-05ae-4327-8edf-91fdf2f8a66b {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:58:23 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:58:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d231442e-05ae-4327-8edf-91fdf2f8a66b 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:23 devstack sudo[97269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d231442e-05ae-4327-8edf-91fdf2f8a66b 1073741824
Sep 09 03:58:23 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:24 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d231442e-05ae-4327-8edf-91fdf2f8a66b 1073741824" returned: 0 in 0.596s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d231442e-05ae-4327-8edf-91fdf2f8a66b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:24 devstack sudo[97276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d231442e-05ae-4327-8edf-91fdf2f8a66b
Sep 09 03:58:24 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:24 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d231442e-05ae-4327-8edf-91fdf2f8a66b" returned: 0 in 0.380s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:58:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dd7e0b-a8f5-48d5-b636-ea453601f7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d231442e-05ae-4327-8edf-91fdf2f8a66b', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3223f8-ba38-40cb-908b-4ea0ba0ca985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:24 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Volume volume-d231442e-05ae-4327-8edf-91fdf2f8a66b (d231442e-05ae-4327-8edf-91fdf2f8a66b): created successfully
Sep 09 03:58:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3223f8-ba38-40cb-908b-4ea0ba0ca985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Flow 'volume_create_manager' (947ab342-b320-4cce-8249-db733b69571c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-97f8d9a0-8f67-41ba-a2b3-b3afd4b349e0 tempest-VolumesTransfersV355Test-619120959 None] Created volume successfully.
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Flow 'volume_create_manager' (8a95beed-f5fe-44c5-a50a-43177a28c6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141da28b-873c-4fbc-8403-6559219f4405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141da28b-873c-4fbc-8403-6559219f4405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492489121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fc1f1f-fba2-4ed7-af12-5e69aac9af44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cde9002154429d8c51c3ac93653110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:26Z,use_quota=True,user_id='0bcdf9524a7b46ce80c14164bbcfd4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07dc03cc-e315-4682-96dc-88015c4bb987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07dc03cc-e315-4682-96dc-88015c4bb987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde5c4c3-ff47-46bd-b0c7-53d8558332c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde5c4c3-ff47-46bd-b0c7-53d8558332c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fc1f1f-fba2-4ed7-af12-5e69aac9af44', 'volume_name': 'volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048d6de3-1296-4a62-87d4-cbc560436904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048d6de3-1296-4a62-87d4-cbc560436904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a193a24-0155-4f69-8f7a-8a5c243d2765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:25 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Volume 95fc1f1f-fba2-4ed7-af12-5e69aac9af44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44', 'volume_size': 1}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492489121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fc1f1f-fba2-4ed7-af12-5e69aac9af44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cde9002154429d8c51c3ac93653110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:26Z,use_quota=True,user_id='0bcdf9524a7b46ce80c14164bbcfd4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Creating volume 95fc1f1f-fba2-4ed7-af12-5e69aac9af44 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:58:25 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:58:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:25 devstack sudo[97283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44 1073741824
Sep 09 03:58:25 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:26 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44 1073741824" returned: 0 in 0.656s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:26 devstack sudo[97289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44
Sep 09 03:58:26 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:26 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:26 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-460369c6-82cf-45b3-b95a-5a6c89de3244 tempest-VolumesTransfersV355Test-327941916 None] Transfer volume completed successfully.
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44" returned: 0 in 0.345s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a193a24-0155-4f69-8f7a-8a5c243d2765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaa6958-8164-4509-9433-51f8cbf91400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:27 devstack sudo[97297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:58:27 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:27 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Volume volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44 (95fc1f1f-fba2-4ed7-af12-5e69aac9af44): created successfully
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaa6958-8164-4509-9433-51f8cbf91400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Flow 'volume_create_manager' (8a95beed-f5fe-44c5-a50a-43177a28c6e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:27 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4b38142b-6c81-4110-99f3-60b0959ba35f tempest-ProjectReaderTests-694434116 None] Created volume successfully.
Sep 09 03:58:27 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.375s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93c7122-f523-4f91-8276-9f2197942841]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:27 devstack sudo[97310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4
Sep 09 03:58:27 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Acquiring lock "cinder-95fc1f1f-fba2-4ed7-af12-5e69aac9af44-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Lock "cinder-95fc1f1f-fba2-4ed7-af12-5e69aac9af44-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Acquiring lock "cinder-quobyte-95fc1f1f-fba2-4ed7-af12-5e69aac9af44" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Acquiring lock "cinder-d231442e-05ae-4327-8edf-91fdf2f8a66b-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Lock "cinder-quobyte-95fc1f1f-fba2-4ed7-af12-5e69aac9af44" acquired by "delete_volume" :: waited 0.041s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d766b2a6-e578-435a-bb57-28205ca019c8]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Lock "cinder-d231442e-05ae-4327-8edf-91fdf2f8a66b-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Acquiring lock "cinder-quobyte-d231442e-05ae-4327-8edf-91fdf2f8a66b" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Lock "cinder-quobyte-d231442e-05ae-4327-8edf-91fdf2f8a66b" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:28 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" returned: 0 in 0.674s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2308e5b-9ca1-4a84-9269-c3c1f3c80d0e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d231442e-05ae-4327-8edf-91fdf2f8a66b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c43fa30-5574-4f8e-894c-952b1622e80c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:28 devstack sudo[97318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44
Sep 09 03:58:28 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:28 devstack sudo[97323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4
Sep 09 03:58:28 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:28 devstack sudo[97322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d231442e-05ae-4327-8edf-91fdf2f8a66b
Sep 09 03:58:28 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:28 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44" returned: 0 in 0.496s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:28 devstack sudo[97333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44
Sep 09 03:58:28 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:28 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" returned: 0 in 0.489s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.71cdc46b-8092-4b55-b981-4449c1b0c64eas61hcs5.img {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:28 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d231442e-05ae-4327-8edf-91fdf2f8a66b" returned: 0 in 0.529s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d231442e-05ae-4327-8edf-91fdf2f8a66b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:28 devstack sudo[97339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.71cdc46b-8092-4b55-b981-4449c1b0c64eas61hcs5.img
Sep 09 03:58:28 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:28 devstack sudo[97341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d231442e-05ae-4327-8edf-91fdf2f8a66b
Sep 09 03:58:28 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:28 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-95fc1f1f-fba2-4ed7-af12-5e69aac9af44" returned: 0 in 0.332s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Lock "cinder-quobyte-95fc1f1f-fba2-4ed7-af12-5e69aac9af44" released by "delete_volume" :: held 0.906s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Created reservations ['7861c5d7-5636-44a3-a86c-6efdaa9aa4ef', '5bbb7119-e977-43c0-a54c-3dde8fae53de', 'aebaf81b-5568-4219-977e-8c15789d7f73', 'e4a7acb6-bfda-4590-b5a2-e97a67015972'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:58:28 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d231442e-05ae-4327-8edf-91fdf2f8a66b" returned: 0 in 0.324s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Lock "cinder-quobyte-d231442e-05ae-4327-8edf-91fdf2f8a66b" released by "delete_volume" :: held 0.912s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Created reservations ['9d17e556-d0de-49c1-8c78-bf35de63dc57', '895b57f7-de13-43e2-81d0-6d3feaa5a111', '5be2da29-3241-4b2b-827b-86dabd285316', 'c5cffa6b-a762-47cd-bd84-f2a6d5311126'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:58:29 devstack sudo[97355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:58:29 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:29 devstack sudo[97358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:58:29 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:29 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.496s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:58:29 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Deleted volume successfully.
Sep 09 03:58:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-520a5f3c-2d1c-48d2-828d-c121ee2e27ad tempest-ProjectReaderTests-694434116 None] Lock "cinder-95fc1f1f-fba2-4ed7-af12-5e69aac9af44-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:30 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.912s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:30 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:58:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Deleted volume successfully.
Sep 09 03:58:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6b201d1e-a25c-484d-a343-42aa833c0769 tempest-VolumesTransfersV355Test-419636342 None] Lock "cinder-d231442e-05ae-4327-8edf-91fdf2f8a66b-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:31 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:58:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Flow 'volume_create_manager' (d70c499b-d0d3-49d7-83bb-d4bb3386fcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c6cccd-1e29-4f4a-85de-dcfb68799ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c6cccd-1e29-4f4a-85de-dcfb68799ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1338949345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=155f66de-a747-44a2-b2fe-d3ec9db506c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cde9002154429d8c51c3ac93653110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:31Z,use_quota=True,user_id='0bcdf9524a7b46ce80c14164bbcfd4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f312ad7-1ca0-479e-a8de-0afd20884b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f312ad7-1ca0-479e-a8de-0afd20884b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac952709-944d-4fe3-b6ff-44efbcde6658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac952709-944d-4fe3-b6ff-44efbcde6658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '155f66de-a747-44a2-b2fe-d3ec9db506c6', 'volume_name': 'volume-155f66de-a747-44a2-b2fe-d3ec9db506c6', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c8d6e6-6a3d-4746-9a0b-212ee2758a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c8d6e6-6a3d-4746-9a0b-212ee2758a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975f9a17-4acb-492c-9499-1ea202941bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:31 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Volume 155f66de-a747-44a2-b2fe-d3ec9db506c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-155f66de-a747-44a2-b2fe-d3ec9db506c6', 'volume_size': 1}
Sep 09 03:58:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:32 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:58:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Flow 'volume_create_manager' (c86ee45f-090a-4982-b2dd-e244784a8088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a73a63-972d-4713-acfb-0d732d1e6368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a73a63-972d-4713-acfb-0d732d1e6368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1254483618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03368920-8ff8-48f2-ac85-0e0a16070be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8765bd733e4347b809e061d0cebcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:32Z,use_quota=True,user_id='1d6d5a4a429c4959bbbdf209b5ff4c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106f0859-05f4-4350-bf70-6248ed48aef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106f0859-05f4-4350-bf70-6248ed48aef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bbafe6-3b17-42c9-bdff-a2b2c7fda1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bbafe6-3b17-42c9-bdff-a2b2c7fda1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03368920-8ff8-48f2-ac85-0e0a16070be4', 'volume_name': 'volume-03368920-8ff8-48f2-ac85-0e0a16070be4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8020363-21bd-424f-86a1-dd56e4505520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8020363-21bd-424f-86a1-dd56e4505520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1d82e9-e033-4537-a13d-5b8cfb32156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:32 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Volume 03368920-8ff8-48f2-ac85-0e0a16070be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03368920-8ff8-48f2-ac85-0e0a16070be4', 'volume_size': 1}
Sep 09 03:58:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:35 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.71cdc46b-8092-4b55-b981-4449c1b0c64eas61hcs5.img" returned: 0 in 6.929s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:35 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f307028-793b-4057-9ea1-3b63e423dc98]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:35 devstack sudo[97436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4
Sep 09 03:58:35 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:36 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" returned: 0 in 0.625s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:36 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.71cdc46b-8092-4b55-b981-4449c1b0c64eas61hcs5.img {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 03:58:36 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] Converted 1024.00 MB image at 147.76 MB/s
Sep 09 03:58:36 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] 71cdc46b-8092-4b55-b981-4449c1b0c64e was raw, no need to convert to raw {{(pid=87558) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 09 03:58:46 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=57,cinder:UPDATE=64,cinder:INSERT=18,cinder:DELETE=2 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:58:46 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=57,cinder:SELECT=48,cinder:INSERT=18,cinder:DELETE=7 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.782s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] Uploaded volume to glance image-id: 71cdc46b-8092-4b55-b981-4449c1b0c64e. {{(pid=87558) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.443s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1338949345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=155f66de-a747-44a2-b2fe-d3ec9db506c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cde9002154429d8c51c3ac93653110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:31Z,use_quota=True,user_id='0bcdf9524a7b46ce80c14164bbcfd4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Creating volume 155f66de-a747-44a2-b2fe-d3ec9db506c6 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:58:56 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-155f66de-a747-44a2-b2fe-d3ec9db506c6 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:56 devstack sudo[97475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-155f66de-a747-44a2-b2fe-d3ec9db506c6 1073741824
Sep 09 03:58:56 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:56 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6db32fc6-cf55-496a-8a9b-e66adf611b93 tempest-VolumesActionsTest-746281324 None] Copy volume to image completed successfully.
Sep 09 03:58:56 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-155f66de-a747-44a2-b2fe-d3ec9db506c6 1073741824" returned: 0 in 0.424s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-155f66de-a747-44a2-b2fe-d3ec9db506c6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:56 devstack sudo[97481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-155f66de-a747-44a2-b2fe-d3ec9db506c6
Sep 09 03:58:56 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:56 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-155f66de-a747-44a2-b2fe-d3ec9db506c6" returned: 0 in 0.247s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.328s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1254483618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03368920-8ff8-48f2-ac85-0e0a16070be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8765bd733e4347b809e061d0cebcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:32Z,use_quota=True,user_id='1d6d5a4a429c4959bbbdf209b5ff4c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Creating volume 03368920-8ff8-48f2-ac85-0e0a16070be4 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:58:56 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-03368920-8ff8-48f2-ac85-0e0a16070be4 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975f9a17-4acb-492c-9499-1ea202941bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-155f66de-a747-44a2-b2fe-d3ec9db506c6', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:56 devstack sudo[97484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-03368920-8ff8-48f2-ac85-0e0a16070be4 1073741824
Sep 09 03:58:56 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f0f2fb-b6f2-4f9e-b7eb-da0a00067050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:56 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Volume volume-155f66de-a747-44a2-b2fe-d3ec9db506c6 (155f66de-a747-44a2-b2fe-d3ec9db506c6): created successfully
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f0f2fb-b6f2-4f9e-b7eb-da0a00067050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Flow 'volume_create_manager' (d70c499b-d0d3-49d7-83bb-d4bb3386fcdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:56 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b621a4b8-2e84-4c13-919b-af6e13d6d434 tempest-ProjectReaderTests-694434116 None] Created volume successfully.
Sep 09 03:58:57 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-03368920-8ff8-48f2-ac85-0e0a16070be4 1073741824" returned: 0 in 0.497s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-03368920-8ff8-48f2-ac85-0e0a16070be4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:57 devstack sudo[97491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-03368920-8ff8-48f2-ac85-0e0a16070be4
Sep 09 03:58:57 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:57 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-03368920-8ff8-48f2-ac85-0e0a16070be4" returned: 0 in 0.288s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1d82e9-e033-4537-a13d-5b8cfb32156f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03368920-8ff8-48f2-ac85-0e0a16070be4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9362a7-4c22-4752-a0da-dbaf1d358b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:57 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Volume volume-03368920-8ff8-48f2-ac85-0e0a16070be4 (03368920-8ff8-48f2-ac85-0e0a16070be4): created successfully
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9362a7-4c22-4752-a0da-dbaf1d358b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Flow 'volume_create_manager' (c86ee45f-090a-4982-b2dd-e244784a8088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:57 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-1ff733a6-8505-4493-9008-ce31eb355ecd tempest-VolumesTransfersV355Test-619120959 None] Created volume successfully.
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Acquiring lock "cinder-155f66de-a747-44a2-b2fe-d3ec9db506c6-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Flow 'volume_create_manager' (40104ed9-dc2b-4a7d-ba78-b7155048e555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bdae48-232d-4178-824b-5936605c345f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bdae48-232d-4178-824b-5936605c345f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1547377362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852e8615-d20a-4589-962a-f812c3e94465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='392fe9e9fe904b43b501a5d63b65371b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:58Z,use_quota=True,user_id='d23d7921d0984dbf901624b5948f9705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a87edde-dab6-49a3-8591-be51cc3a6966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a87edde-dab6-49a3-8591-be51cc3a6966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae01cd3-0553-4276-bdb4-7900bbae6d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae01cd3-0553-4276-bdb4-7900bbae6d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852e8615-d20a-4589-962a-f812c3e94465', 'volume_name': 'volume-852e8615-d20a-4589-962a-f812c3e94465', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a79a68f-33f5-4598-b7cf-aaabed3d13f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a79a68f-33f5-4598-b7cf-aaabed3d13f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29651390-72da-46d4-b976-25e323bcf733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:57 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Volume 852e8615-d20a-4589-962a-f812c3e94465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852e8615-d20a-4589-962a-f812c3e94465', 'volume_size': 1}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1547377362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852e8615-d20a-4589-962a-f812c3e94465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='392fe9e9fe904b43b501a5d63b65371b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:58Z,use_quota=True,user_id='d23d7921d0984dbf901624b5948f9705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Creating volume 852e8615-d20a-4589-962a-f812c3e94465 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:58:57 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:58:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-852e8615-d20a-4589-962a-f812c3e94465 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Lock "cinder-155f66de-a747-44a2-b2fe-d3ec9db506c6-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:58 devstack sudo[97494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-852e8615-d20a-4589-962a-f812c3e94465 1073741824
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Acquiring lock "cinder-quobyte-155f66de-a747-44a2-b2fe-d3ec9db506c6" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:58 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Lock "cinder-quobyte-155f66de-a747-44a2-b2fe-d3ec9db506c6" acquired by "delete_volume" :: waited 0.042s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[36930193-1ef2-433e-aa9f-d917ba334e9d]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-155f66de-a747-44a2-b2fe-d3ec9db506c6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:58 devstack sudo[97496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-155f66de-a747-44a2-b2fe-d3ec9db506c6
Sep 09 03:58:58 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Acquiring lock "cinder-03368920-8ff8-48f2-ac85-0e0a16070be4-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Lock "cinder-03368920-8ff8-48f2-ac85-0e0a16070be4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:58 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-852e8615-d20a-4589-962a-f812c3e94465 1073741824" returned: 0 in 0.550s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Acquiring lock "cinder-quobyte-03368920-8ff8-48f2-ac85-0e0a16070be4" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Lock "cinder-quobyte-03368920-8ff8-48f2-ac85-0e0a16070be4" acquired by "delete_volume" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:58:58 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-155f66de-a747-44a2-b2fe-d3ec9db506c6" returned: 0 in 0.479s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-155f66de-a747-44a2-b2fe-d3ec9db506c6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b962e289-d43a-42ea-a64a-d700814b266f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-03368920-8ff8-48f2-ac85-0e0a16070be4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:58 devstack sudo[97505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-155f66de-a747-44a2-b2fe-d3ec9db506c6
Sep 09 03:58:58 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-852e8615-d20a-4589-962a-f812c3e94465 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:58 devstack sudo[97508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-852e8615-d20a-4589-962a-f812c3e94465
Sep 09 03:58:58 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:58 devstack sudo[97506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-03368920-8ff8-48f2-ac85-0e0a16070be4
Sep 09 03:58:58 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:58 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-155f66de-a747-44a2-b2fe-d3ec9db506c6" returned: 0 in 0.281s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:58 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-852e8615-d20a-4589-962a-f812c3e94465" returned: 0 in 0.266s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Lock "cinder-quobyte-155f66de-a747-44a2-b2fe-d3ec9db506c6" released by "delete_volume" :: held 0.820s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.802s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29651390-72da-46d4-b976-25e323bcf733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852e8615-d20a-4589-962a-f812c3e94465', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573606d8-9e7f-4c11-9260-4cff91c6ae5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9371e23-dd26-4bdb-81a8-1a23e811b030]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:58 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Volume volume-852e8615-d20a-4589-962a-f812c3e94465 (852e8615-d20a-4589-962a-f812c3e94465): created successfully
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573606d8-9e7f-4c11-9260-4cff91c6ae5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:58:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Flow 'volume_create_manager' (40104ed9-dc2b-4a7d-ba78-b7155048e555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:58:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4bc29945-c11f-4ada-bdde-9372dd16d12e tempest-AttachVolumeShelveTestJSON-118742061 None] Created volume successfully.
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Created reservations ['ec741dd4-9dac-4bd5-9bcd-ee41d1d8b9d5', '01dd3288-f28a-4677-87aa-8e646c49ba58', '64ab3556-03d2-415a-9b91-9c1959193f26', '6b76167b-3037-4b55-bdcf-66bda1cfb14a'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:58:59 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-03368920-8ff8-48f2-ac85-0e0a16070be4" returned: 0 in 0.416s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-03368920-8ff8-48f2-ac85-0e0a16070be4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:59 devstack sudo[97515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4
Sep 09 03:58:59 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:59 devstack sudo[97517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-03368920-8ff8-48f2-ac85-0e0a16070be4
Sep 09 03:58:59 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:59 devstack sudo[97520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:58:59 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:59 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-03368920-8ff8-48f2-ac85-0e0a16070be4" returned: 0 in 0.283s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:59 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" returned: 0 in 0.404s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Lock "cinder-quobyte-03368920-8ff8-48f2-ac85-0e0a16070be4" released by "delete_volume" :: held 0.755s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90a19c5-31b8-44bf-84ba-6ae854074fbe]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:59 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.255s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:58:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Deleted volume successfully.
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Created reservations ['e86d23be-4195-4d46-a58e-b50fa3484411', 'cd7b6e36-da2d-4549-8596-50c48d2de6a3', 'ec1632ec-fbe4-4c55-ae93-1a66e398ad07', '5a95cf98-1b9e-4165-81cb-396009654d75'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-054fbcab-cc92-42a5-a24c-3e23805cf3d0 tempest-ProjectReaderTests-694434116 None] Lock "cinder-155f66de-a747-44a2-b2fe-d3ec9db506c6-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:58:59 devstack sudo[97527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4
Sep 09 03:58:59 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:59 devstack sudo[97529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:58:59 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:59 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" returned: 0 in 0.387s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:58:59 devstack sudo[97535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img
Sep 09 03:58:59 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:58:59 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.294s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:58:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Deleted volume successfully.
Sep 09 03:58:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c2e14066-8f70-4af4-a556-87141feb16d0 tempest-VolumesTransfersV355Test-419636342 None] Lock "cinder-03368920-8ff8-48f2-ac85-0e0a16070be4-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img" returned: 0 in 6.160s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:05 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba25d2c-fd53-4318-91fe-fd9ab6e9872a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:06 devstack sudo[97601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4
Sep 09 03:59:06 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:06 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" returned: 0 in 0.778s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:06 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 03:59:06 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Converted 1024.00 MB image at 166.20 MB/s
Sep 09 03:59:06 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] c63ebc39-b9ea-4fa7-aa02-555e06993008 was raw, converting to qcow2 {{(pid=87558) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Sep 09 03:59:06 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80a3432-7781-4526-b24d-d918fe4a6d04]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:06 devstack sudo[97606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img
Sep 09 03:59:06 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:07 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img" returned: 0 in 0.387s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:07 devstack sudo[97610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img
Sep 09 03:59:07 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:07 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img" returned: 1 in 0.394s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 03:59:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img /opt/stack/data/cinder/conversion/vol_upload_nnqu4ric {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:07 devstack sudo[97615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img /opt/stack/data/cinder/conversion/vol_upload_nnqu4ric
Sep 09 03:59:07 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:07 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img /opt/stack/data/cinder/conversion/vol_upload_nnqu4ric" returned: 0 in 0.424s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:07 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Image conversion details: src /opt/stack/data/cinder/conversion/99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4.temp_image.c63ebc39-b9ea-4fa7-aa02-555e06993008ohj1w3md.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_nnqu4ric {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 03:59:07 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 09 03:59:07 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[344b758b-2934-49cd-9274-229e273a3b37]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nnqu4ric {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:08 devstack sudo[97622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nnqu4ric
Sep 09 03:59:08 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:08 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nnqu4ric" returned: 0 in 0.492s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.335s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Uploaded volume to glance image-id: c63ebc39-b9ea-4fa7-aa02-555e06993008. {{(pid=87558) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 09 03:59:11 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0e81d9a6-0360-430c-a1b8-4f17b1ee8011 tempest-VolumesActionsTest-746281324 None] Copy volume to image completed successfully.
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Flow 'volume_create_manager' (6ebafbaa-a2ef-4567-be13-b61ea07362d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a5c6e5-07dc-4648-a57f-de036c08ba48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a5c6e5-07dc-4648-a57f-de036c08ba48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1874149791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a772e01-ec82-414d-a45c-41be014121d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c2a395baab4862938b457523517c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:12Z,use_quota=True,user_id='615ad2657fc14d449f7fa9e5081e08c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f891855a-41a1-4c21-b435-b5a792f627bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f891855a-41a1-4c21-b435-b5a792f627bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1b7d51-483f-4c48-96cc-40b1fa3988cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1b7d51-483f-4c48-96cc-40b1fa3988cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a772e01-ec82-414d-a45c-41be014121d4', 'volume_name': 'volume-5a772e01-ec82-414d-a45c-41be014121d4', 'volume_size': 2}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf16cf1-5da6-43c3-b31d-d91fff1b66f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf16cf1-5da6-43c3-b31d-d91fff1b66f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54dd767b-ef4f-427d-98f4-ab6f0c6e2223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:11 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Volume 5a772e01-ec82-414d-a45c-41be014121d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a772e01-ec82-414d-a45c-41be014121d4', 'volume_size': 2}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1874149791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a772e01-ec82-414d-a45c-41be014121d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c2a395baab4862938b457523517c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:12Z,use_quota=True,user_id='615ad2657fc14d449f7fa9e5081e08c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Creating volume 5a772e01-ec82-414d-a45c-41be014121d4 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:59:11 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:59:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a772e01-ec82-414d-a45c-41be014121d4 2147483648 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:11 devstack sudo[97629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a772e01-ec82-414d-a45c-41be014121d4 2147483648
Sep 09 03:59:11 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Acquiring lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Acquiring lock "cinder-quobyte-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Lock "cinder-quobyte-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:12 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda275e4-8774-4b2e-9212-3386eb14f764]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:12 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a772e01-ec82-414d-a45c-41be014121d4 2147483648" returned: 0 in 0.757s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:12 devstack sudo[97635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4
Sep 09 03:59:12 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a772e01-ec82-414d-a45c-41be014121d4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:12 devstack sudo[97637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a772e01-ec82-414d-a45c-41be014121d4
Sep 09 03:59:12 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:12 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a772e01-ec82-414d-a45c-41be014121d4" returned: 0 in 0.344s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:59:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54dd767b-ef4f-427d-98f4-ab6f0c6e2223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a772e01-ec82-414d-a45c-41be014121d4', 'volume_size': 2}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97283997-d147-4b1d-8e82-c8c1f0f5e4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:13 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" returned: 0 in 0.549s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:13 devstack sudo[97645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4
Sep 09 03:59:13 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:13 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Volume volume-5a772e01-ec82-414d-a45c-41be014121d4 (5a772e01-ec82-414d-a45c-41be014121d4): created successfully
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97283997-d147-4b1d-8e82-c8c1f0f5e4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Flow 'volume_create_manager' (6ebafbaa-a2ef-4567-be13-b61ea07362d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:13 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-392b6d64-ad99-43c5-84ca-9a0dfb5c7f66 tempest-VolumesCloneNegativeTest-1687492131 None] Created volume successfully.
Sep 09 03:59:13 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" returned: 0 in 0.455s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Lock "cinder-quobyte-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4" released by "delete_volume" :: held 1.063s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Created reservations ['99793aa2-162f-4b4a-b7a8-79b9ec222673', '9c70a03b-437a-4e22-91dd-cde65447f143', '3fbb9795-69d9-440c-a44e-33f44118de8a', '118d2416-7055-4b5c-8d55-746da99b1758'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:13 devstack sudo[97665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:59:13 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:13 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.325s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:13 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:59:14 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Deleted volume successfully.
Sep 09 03:59:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8afd45d8-c0c1-4d81-b6a3-9240ed01d067 tempest-VolumesActionsTest-746281324 None] Lock "cinder-99fc3ed9-8fb0-4b94-9a42-f2044be8e1a4-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Acquiring lock "cinder-5a772e01-ec82-414d-a45c-41be014121d4-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Lock "cinder-5a772e01-ec82-414d-a45c-41be014121d4-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Acquiring lock "cinder-quobyte-5a772e01-ec82-414d-a45c-41be014121d4" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Lock "cinder-quobyte-5a772e01-ec82-414d-a45c-41be014121d4" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:14 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8a5291-fe33-468a-8c69-e20f77a7174c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a772e01-ec82-414d-a45c-41be014121d4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:14 devstack sudo[97669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a772e01-ec82-414d-a45c-41be014121d4
Sep 09 03:59:14 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:14 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a772e01-ec82-414d-a45c-41be014121d4" returned: 0 in 0.420s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a772e01-ec82-414d-a45c-41be014121d4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:14 devstack sudo[97675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a772e01-ec82-414d-a45c-41be014121d4
Sep 09 03:59:14 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:15 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a772e01-ec82-414d-a45c-41be014121d4" returned: 0 in 0.309s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:15 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Lock "cinder-quobyte-5a772e01-ec82-414d-a45c-41be014121d4" released by "delete_volume" :: held 0.791s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:15 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Created reservations ['0d509c40-13ab-4145-9294-dc4d5f76fcfa', '054e3a0d-2bad-48de-83ae-5678c5d977a1', '654a932c-50ab-461a-a341-05181a070ee5', '6927abb1-86c6-42aa-8395-02f49fae0aeb'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:59:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:15 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:15 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:15 devstack sudo[97679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:59:15 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:15 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.344s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:15 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:59:15 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Deleted volume successfully.
Sep 09 03:59:15 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6748f29f-1711-4eab-936b-aa2539a9e8a8 tempest-VolumesCloneNegativeTest-1687492131 None] Lock "cinder-5a772e01-ec82-414d-a45c-41be014121d4-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-fc207719-39ba-4f72-bdfc-4d2ab4463ac7 req-1d4bbef9-2df9-4f44-96a4-2f297b862c1b tempest-AttachVolumeShelveTestJSON-118742061 None] No connector for attachment 0c8f869b-a95a-4dfc-bc52-a63e1e083a98; skipping storage backend terminate_connection call. {{(pid=87558) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 09 03:59:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-fc207719-39ba-4f72-bdfc-4d2ab4463ac7 req-1d4bbef9-2df9-4f44-96a4-2f297b862c1b tempest-AttachVolumeShelveTestJSON-118742061 None] Deleting attachment 0c8f869b-a95a-4dfc-bc52-a63e1e083a98. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (6dc7a660-72ac-4caa-9e38-3b8311519317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41136f49-043c-4800-9f6b-55b4115f1100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41136f49-043c-4800-9f6b-55b4115f1100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-955481555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0a9ac3-52c8-4c63-b07d-72d11881e4a9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fee11c10f2a24def80d77cf6abebb6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:23Z,use_quota=True,user_id='8af7a3b9e1224933811ace51a425e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b84ec5-c0c6-4b4d-98ec-9f7c04f24812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b84ec5-c0c6-4b4d-98ec-9f7c04f24812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a18d2a2-0944-4b37-8ad5-a4e4bf20cf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a18d2a2-0944-4b37-8ad5-a4e4bf20cf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0a9ac3-52c8-4c63-b07d-72d11881e4a9', 'volume_name': 'volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fef5319-7b3e-48c9-8555-1e5f268a4ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fef5319-7b3e-48c9-8555-1e5f268a4ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7192a959-893a-42aa-85a9-fb75d9baeed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:23 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Volume 6c0a9ac3-52c8-4c63-b07d-72d11881e4a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9', 'volume_size': 1}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-955481555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0a9ac3-52c8-4c63-b07d-72d11881e4a9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fee11c10f2a24def80d77cf6abebb6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:23Z,use_quota=True,user_id='8af7a3b9e1224933811ace51a425e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Creating volume 6c0a9ac3-52c8-4c63-b07d-72d11881e4a9 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:59:23 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:23 devstack sudo[97694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9 1073741824
Sep 09 03:59:23 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:23 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9 1073741824" returned: 0 in 0.633s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:23 devstack sudo[97703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9
Sep 09 03:59:23 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:24 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9" returned: 0 in 0.295s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:59:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7192a959-893a-42aa-85a9-fb75d9baeed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a463d2-f332-4080-bc32-0ac0c736c66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:24 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Volume volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9 (6c0a9ac3-52c8-4c63-b07d-72d11881e4a9): created successfully
Sep 09 03:59:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a463d2-f332-4080-bc32-0ac0c736c66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (6dc7a660-72ac-4caa-9e38-3b8311519317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:24 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9d429588-137e-4914-a068-4ee79e1b8b2a tempest-VolumesGetTest-1866198425 None] Created volume successfully.
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (c2b13af8-3d16-43d5-ba7e-503c671259ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c035a2e-3b96-47a4-974a-841aace1847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c035a2e-3b96-47a4-974a-841aace1847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-944200362',display_name='tempest-VolumesGetTest-Volume-1505916685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5069c12-4caf-411f-94c7-b4c8dfb2224c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee11c10f2a24def80d77cf6abebb6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:26Z,use_quota=True,user_id='8af7a3b9e1224933811ace51a425e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a60241-2dd1-48c9-92da-e16bd6f5914c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a60241-2dd1-48c9-92da-e16bd6f5914c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b02b10-cc83-47cf-af25-01ccf7298e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b02b10-cc83-47cf-af25-01ccf7298e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5069c12-4caf-411f-94c7-b4c8dfb2224c', 'volume_name': 'volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4751127-e83a-4de9-9622-68f1500a9ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4751127-e83a-4de9-9622-68f1500a9ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccb5ef9-318e-4c1f-afb3-f5e4ae683678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:26 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Volume a5069c12-4caf-411f-94c7-b4c8dfb2224c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c', 'volume_size': 1}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-944200362',display_name='tempest-VolumesGetTest-Volume-1505916685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5069c12-4caf-411f-94c7-b4c8dfb2224c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee11c10f2a24def80d77cf6abebb6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:26Z,use_quota=True,user_id='8af7a3b9e1224933811ace51a425e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Creating volume a5069c12-4caf-411f-94c7-b4c8dfb2224c {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:59:26 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:26 devstack sudo[97708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c 1073741824
Sep 09 03:59:26 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:27 devstack sudo[97713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:59:27 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:27 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c 1073741824" returned: 0 in 0.833s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:27 devstack sudo[97716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c
Sep 09 03:59:27 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:27 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.585s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 03:59:27 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c" returned: 0 in 0.398s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccb5ef9-318e-4c1f-afb3-f5e4ae683678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2267bb96-579f-4870-99ca-c05cbd359e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:27 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Volume volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c (a5069c12-4caf-411f-94c7-b4c8dfb2224c): created successfully
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2267bb96-579f-4870-99ca-c05cbd359e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (c2b13af8-3d16-43d5-ba7e-503c671259ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:27 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d7deb278-5ddf-4a28-ae3c-27a1b05c6490 tempest-VolumesGetTest-1866198425 None] Created volume successfully.
Sep 09 03:59:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-a5069c12-4caf-411f-94c7-b4c8dfb2224c-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Lock "cinder-a5069c12-4caf-411f-94c7-b4c8dfb2224c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-quobyte-a5069c12-4caf-411f-94c7-b4c8dfb2224c" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-a5069c12-4caf-411f-94c7-b4c8dfb2224c" acquired by "delete_volume" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:29 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4a3182-d105-4cf3-9f99-ae4f889be2e4]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:29 devstack sudo[97720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c
Sep 09 03:59:29 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:29 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c" returned: 0 in 0.573s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:29 devstack sudo[97725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c
Sep 09 03:59:29 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:29 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a5069c12-4caf-411f-94c7-b4c8dfb2224c" returned: 0 in 0.327s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-a5069c12-4caf-411f-94c7-b4c8dfb2224c" released by "delete_volume" :: held 0.977s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:30 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Created reservations ['d43f9f64-1cbd-419b-86d5-4923278d721d', 'f13622dc-cd0a-429b-ba02-fb013224c20c', '2e2ba48f-d5d7-4fb1-a149-71447d72a38d', '216a070a-75dc-4456-95c8-f2555ba79b76'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:59:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:30 devstack sudo[97729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:59:30 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:30 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.386s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:30 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:59:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Deleted volume successfully.
Sep 09 03:59:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-51927c16-0b3a-4c3b-b109-359a55519322 tempest-VolumesGetTest-1866198425 None] Lock "cinder-a5069c12-4caf-411f-94c7-b4c8dfb2224c-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Lock "cinder-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-quobyte-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:31 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[7023a12a-9120-4c35-9f88-ee6e3e7ae0c0]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:31 devstack sudo[97757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9
Sep 09 03:59:31 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:31 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9" returned: 0 in 0.513s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:31 devstack sudo[97770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9
Sep 09 03:59:31 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:32 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9" returned: 0 in 0.327s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9" released by "delete_volume" :: held 0.903s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:32 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Created reservations ['5956c656-ec27-4534-9282-cb1242b8bda9', '0fec0cb9-292b-4814-bbf5-9ca676311d1b', '25756f27-2fc7-498c-ae2f-a3bf33dfe885', '75e6f1ac-eb49-4a1b-ad0c-d3ca0c895cf9'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:59:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:32 devstack sudo[97774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:59:32 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:32 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.414s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:32 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:59:32 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Deleted volume successfully.
Sep 09 03:59:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f0cdae7-5547-4baf-8ee0-b98628566be1 tempest-VolumesGetTest-1866198425 None] Lock "cinder-6c0a9ac3-52c8-4c63-b07d-72d11881e4a9-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (237b91ca-3f02-45f4-87df-bc9ce8d069a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0583119-ea3c-48a0-89ec-102e4a171a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0583119-ea3c-48a0-89ec-102e4a171a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-483374299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b04ca59-7554-4466-8054-13f0950ce6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee11c10f2a24def80d77cf6abebb6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:34Z,use_quota=True,user_id='8af7a3b9e1224933811ace51a425e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f45e51-575f-475a-8150-5b23fb6ed3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f45e51-575f-475a-8150-5b23fb6ed3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d037aec4-1940-4e0a-99aa-16b1126aa3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d037aec4-1940-4e0a-99aa-16b1126aa3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b04ca59-7554-4466-8054-13f0950ce6e2', 'volume_name': 'volume-6b04ca59-7554-4466-8054-13f0950ce6e2', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be65f0b4-f8dc-461f-b0c2-fc54d3a28e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be65f0b4-f8dc-461f-b0c2-fc54d3a28e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7219bc21-fc2c-4068-bdff-9b7216da3516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:34 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Volume 6b04ca59-7554-4466-8054-13f0950ce6e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b04ca59-7554-4466-8054-13f0950ce6e2', 'volume_size': 1}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-483374299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b04ca59-7554-4466-8054-13f0950ce6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee11c10f2a24def80d77cf6abebb6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:34Z,use_quota=True,user_id='8af7a3b9e1224933811ace51a425e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Creating volume 6b04ca59-7554-4466-8054-13f0950ce6e2 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:59:34 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:59:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:34 devstack sudo[97777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2 1073741824
Sep 09 03:59:34 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Flow 'volume_create_manager' (3dda6e1e-10e2-4533-9584-de42c172198d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65f7ae7-a43d-4989-80a0-21b093dc2766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65f7ae7-a43d-4989-80a0-21b093dc2766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-163392230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4226133-a57d-444b-9e3c-d92cc4f6dcef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a09c06abae6c43a8a8be61dc09a2d0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:35Z,use_quota=True,user_id='5dd2199395b84328950eddbcb96e12f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f8b8bbd-7b75-4dbe-aecb-1e67d797cb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f8b8bbd-7b75-4dbe-aecb-1e67d797cb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:35 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4487c0b-06ea-414f-8c96-e5215f551214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4487c0b-06ea-414f-8c96-e5215f551214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4226133-a57d-444b-9e3c-d92cc4f6dcef', 'volume_name': 'volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e66062a-d8ee-4b2c-aaa5-cfab89839302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e66062a-d8ee-4b2c-aaa5-cfab89839302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f12a127-b474-4fae-b9f2-afc809932019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:35 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Volume f4226133-a57d-444b-9e3c-d92cc4f6dcef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef', 'volume_size': 1}
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2 1073741824" returned: 0 in 1.069s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:35 devstack sudo[97847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2
Sep 09 03:59:35 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:36 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2" returned: 0 in 0.583s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.640s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-163392230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4226133-a57d-444b-9e3c-d92cc4f6dcef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a09c06abae6c43a8a8be61dc09a2d0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:35Z,use_quota=True,user_id='5dd2199395b84328950eddbcb96e12f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Creating volume f4226133-a57d-444b-9e3c-d92cc4f6dcef {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:59:36 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7219bc21-fc2c-4068-bdff-9b7216da3516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b04ca59-7554-4466-8054-13f0950ce6e2', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b371d3dd-fbd4-4386-b345-0aa5631272ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:36 devstack sudo[97856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef 1073741824
Sep 09 03:59:36 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:36 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Volume volume-6b04ca59-7554-4466-8054-13f0950ce6e2 (6b04ca59-7554-4466-8054-13f0950ce6e2): created successfully
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b371d3dd-fbd4-4386-b345-0aa5631272ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (237b91ca-3f02-45f4-87df-bc9ce8d069a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:36 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7bae7ec1-b162-4d36-8002-15d65803cf73 tempest-VolumesGetTest-1866198425 None] Created volume successfully.
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Flow 'volume_create_manager' (b4208895-160d-4225-8168-bfa7680e255f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d2394d-5df0-41e6-920f-f70587ba24b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d2394d-5df0-41e6-920f-f70587ba24b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1845004046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924e1f86-a527-4155-8f19-edac8ef68319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ddd164fbfe34714a044498d32b9fd1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:36Z,use_quota=True,user_id='489ea01b64df456aba23b74b2c019140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d0b04a-585c-4c20-8a2b-f19b68a9cb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d0b04a-585c-4c20-8a2b-f19b68a9cb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b739ca52-f25e-4618-9da6-b441dde77c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b739ca52-f25e-4618-9da6-b441dde77c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924e1f86-a527-4155-8f19-edac8ef68319', 'volume_name': 'volume-924e1f86-a527-4155-8f19-edac8ef68319', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6f6720-4936-490d-a1bf-766afcdaab2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6f6720-4936-490d-a1bf-766afcdaab2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13c7480-5373-4e90-97b4-f65f1b490764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:36 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Volume 924e1f86-a527-4155-8f19-edac8ef68319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924e1f86-a527-4155-8f19-edac8ef68319', 'volume_size': 1}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:36 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef 1073741824" returned: 0 in 0.715s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:36 devstack sudo[97864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef
Sep 09 03:59:36 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:37 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef" returned: 0 in 0.386s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.491s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1845004046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924e1f86-a527-4155-8f19-edac8ef68319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ddd164fbfe34714a044498d32b9fd1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:36Z,use_quota=True,user_id='489ea01b64df456aba23b74b2c019140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Creating volume 924e1f86-a527-4155-8f19-edac8ef68319 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:59:37 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f12a127-b474-4fae-b9f2-afc809932019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:37 devstack sudo[97867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319 1073741824
Sep 09 03:59:37 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a09d47-7108-4834-be29-1a2b63ba4a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:37 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Volume volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef (f4226133-a57d-444b-9e3c-d92cc4f6dcef): created successfully
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a09d47-7108-4834-be29-1a2b63ba4a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Flow 'volume_create_manager' (3dda6e1e-10e2-4533-9584-de42c172198d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:37 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d1bada60-8bdd-4686-a916-84ba36a96fdf tempest-VolumesListTestJSON-1577981898 None] Created volume successfully.
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (d54e295d-8d8f-4fda-b675-f47289a8f501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7eab11-35c5-465b-9b3c-9ae329d5a840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7eab11-35c5-465b-9b3c-9ae329d5a840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-454675198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db6a954-37d8-4217-a404-f7ac10dce489,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fee11c10f2a24def80d77cf6abebb6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=6b04ca59-7554-4466-8054-13f0950ce6e2,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:37Z,use_quota=True,user_id='8af7a3b9e1224933811ace51a425e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618d591d-3add-497d-bc21-d085c70fa33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618d591d-3add-497d-bc21-d085c70fa33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd3200e-2341-40c0-b47e-440b268d3478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd3200e-2341-40c0-b47e-440b268d3478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2db6a954-37d8-4217-a404-f7ac10dce489', 'volume_name': 'volume-2db6a954-37d8-4217-a404-f7ac10dce489', 'volume_size': 1, 'source_volid': '6b04ca59-7554-4466-8054-13f0950ce6e2', 'source_volstatus': 'available'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b2ccff-9f93-49e1-8260-ab43ce05bcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b2ccff-9f93-49e1-8260-ab43ce05bcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab47742-39b3-403f-a0ed-0f5f0c87947c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:37 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Volume 2db6a954-37d8-4217-a404-f7ac10dce489: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2db6a954-37d8-4217-a404-f7ac10dce489', 'volume_size': 1, 'source_volid': '6b04ca59-7554-4466-8054-13f0950ce6e2', 'source_volstatus': 'available'}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:37 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319 1073741824" returned: 0 in 0.561s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:37 devstack sudo[97874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319
Sep 09 03:59:37 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:38 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319" returned: 0 in 0.286s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.535s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:38 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Cloning volume 6b04ca59-7554-4466-8054-13f0950ce6e2 to volume 2db6a954-37d8-4217-a404-f7ac10dce489
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13c7480-5373-4e90-97b4-f65f1b490764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924e1f86-a527-4155-8f19-edac8ef68319', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c38ae88-1c9c-4599-8a6c-48b1f28f2bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:38 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Volume volume-924e1f86-a527-4155-8f19-edac8ef68319 (924e1f86-a527-4155-8f19-edac8ef68319): created successfully
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c38ae88-1c9c-4599-8a6c-48b1f28f2bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Flow 'volume_create_manager' (b4208895-160d-4225-8168-bfa7680e255f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Creating offline snapshot d2946842-fe2f-4a57-acda-7592a0e724d3 of volume 6b04ca59-7554-4466-8054-13f0950ce6e2 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:59:38 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4d81ffdc-01b4-4335-bc25-01dbe91d768f tempest-SnapshotDependencyTests-191865138 None] Created volume successfully.
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece34c98-ee5b-4649-902f-2c91e61a7dfa]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:38 devstack sudo[97877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2
Sep 09 03:59:38 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:38 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2" returned: 0 in 0.556s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:38 devstack sudo[97883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3 1G
Sep 09 03:59:38 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Flow 'volume_create_manager' (b3ec6201-8635-4048-9240-8471f08a593b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b9fd75-c9ee-4fed-b447-ddbb989a2d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b9fd75-c9ee-4fed-b447-ddbb989a2d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-418240696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3975b30-8cd8-419b-8da2-8ee54848cd61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a09c06abae6c43a8a8be61dc09a2d0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:39Z,use_quota=True,user_id='5dd2199395b84328950eddbcb96e12f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d6f37d-fef8-4635-a2af-466ce9b34dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d6f37d-fef8-4635-a2af-466ce9b34dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aadebe0-29de-4d98-a088-cfdbde664d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aadebe0-29de-4d98-a088-cfdbde664d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3975b30-8cd8-419b-8da2-8ee54848cd61', 'volume_name': 'volume-d3975b30-8cd8-419b-8da2-8ee54848cd61', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468f2942-4e69-424b-a17d-e8246551a2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468f2942-4e69-424b-a17d-e8246551a2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00292e13-61f9-4258-ab64-a1a30b45c739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:39 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Volume d3975b30-8cd8-419b-8da2-8ee54848cd61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3975b30-8cd8-419b-8da2-8ee54848cd61', 'volume_size': 1}
Sep 09 03:59:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:39 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3 1G" returned: 0 in 0.473s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b04ca59-7554-4466-8054-13f0950ce6e2 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:39 devstack sudo[97889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b04ca59-7554-4466-8054-13f0950ce6e2 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3
Sep 09 03:59:39 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:39 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b04ca59-7554-4466-8054-13f0950ce6e2 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3" returned: 0 in 0.298s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:39 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3 is being set with open permissions: ugo+rw
Sep 09 03:59:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:39 devstack sudo[97894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3
Sep 09 03:59:39 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:39 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3" returned: 0 in 0.242s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:39 devstack sudo[97897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.info
Sep 09 03:59:39 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:40 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.info" returned: 0 in 0.244s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:40 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.info is being set with open permissions: ugo+rw
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:40 devstack sudo[97900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.info
Sep 09 03:59:40 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:40 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.info" returned: 0 in 0.235s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-quobyte-2db6a954-37d8-4217-a404-f7ac10dce489" by "_copy_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-2db6a954-37d8-4217-a404-f7ac10dce489" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] snapshot: d2946842-fe2f-4a57-acda-7592a0e724d3, volume: 2db6a954-37d8-4217-a404-f7ac10dce489,  {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30ee5ca-b6ef-4bfd-95ec-fdbbd74ea0e1]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:40 devstack sudo[97903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3
Sep 09 03:59:40 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:40 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3" returned: 0 in 0.379s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b04ca59-7554-4466-8054-13f0950ce6e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[732f1619-3bb5-4955-b5a5-4db829a84e45]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:40 devstack sudo[97908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2
Sep 09 03:59:40 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:41 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2" returned: 0 in 0.360s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2 {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 03:59:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Creating direct copy from snapshot {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 03:59:41 devstack cinder-volume[87558]: DEBUG cinder.utils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Path /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489 not found in is_blk_device check {{(pid=87558) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 03:59:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:41 devstack sudo[97913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489
Sep 09 03:59:41 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:46 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489" returned: 0 in 5.008s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489 {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 03:59:46 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Converted 1024.00 MB image at 204.40 MB/s
Sep 09 03:59:46 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489 is being set with open permissions: ugo+rw
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:46 devstack sudo[97927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489
Sep 09 03:59:46 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:46 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489" returned: 0 in 0.258s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-2db6a954-37d8-4217-a404-f7ac10dce489" released by "_copy_volume_from_snapshot" :: held 6.098s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=63,cinder:UPDATE=74,cinder:DELETE=10,cinder:INSERT=18 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-quobyte-d2946842-fe2f-4a57-acda-7592a0e724d3" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-d2946842-fe2f-4a57-acda-7592a0e724d3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Deleting offline snapshot d2946842-fe2f-4a57-acda-7592a0e724d3 of volume 6b04ca59-7554-4466-8054-13f0950ce6e2 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] snapshot_file for this snap is: volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fa490d-f1ab-4739-913b-0dc71155859f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:46 devstack sudo[97930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3
Sep 09 03:59:46 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:46 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3" returned: 0 in 0.368s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b04ca59-7554-4466-8054-13f0950ce6e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf9dbe1-c7e9-4d27-a718-20d90154852f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:47 devstack sudo[97935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2
Sep 09 03:59:47 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:47 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2" returned: 0 in 0.542s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:47 devstack sudo[97941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3
Sep 09 03:59:47 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:47 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3" returned: 0 in 0.370s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:47 devstack sudo[97946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3
Sep 09 03:59:47 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:48 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2.d2946842-fe2f-4a57-acda-7592a0e724d3" returned: 0 in 0.246s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-d2946842-fe2f-4a57-acda-7592a0e724d3" released by "_delete_snapshot" :: held 1.622s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=83,cinder:INSERT=17,cinder:SELECT=48,cinder:DELETE=5 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.204s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-418240696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3975b30-8cd8-419b-8da2-8ee54848cd61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a09c06abae6c43a8a8be61dc09a2d0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:39Z,use_quota=True,user_id='5dd2199395b84328950eddbcb96e12f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Creating volume d3975b30-8cd8-419b-8da2-8ee54848cd61 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:59:48 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3975b30-8cd8-419b-8da2-8ee54848cd61 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:48 devstack sudo[97949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3975b30-8cd8-419b-8da2-8ee54848cd61 1073741824
Sep 09 03:59:48 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab47742-39b3-403f-a0ed-0f5f0c87947c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2db6a954-37d8-4217-a404-f7ac10dce489', 'volume_size': 1, 'source_volid': '6b04ca59-7554-4466-8054-13f0950ce6e2', 'source_volstatus': 'available'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9db6355-2684-447f-9488-eabdf2f8f95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:48 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Volume volume-2db6a954-37d8-4217-a404-f7ac10dce489 (2db6a954-37d8-4217-a404-f7ac10dce489): created successfully
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9db6355-2684-447f-9488-eabdf2f8f95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (d54e295d-8d8f-4fda-b675-f47289a8f501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:48 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d0351473-aa99-4bef-9a90-57696461a608 tempest-VolumesGetTest-1866198425 None] Created volume successfully.
Sep 09 03:59:48 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3975b30-8cd8-419b-8da2-8ee54848cd61 1073741824" returned: 0 in 0.521s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3975b30-8cd8-419b-8da2-8ee54848cd61 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:48 devstack sudo[97954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3975b30-8cd8-419b-8da2-8ee54848cd61
Sep 09 03:59:48 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:49 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3975b30-8cd8-419b-8da2-8ee54848cd61" returned: 0 in 0.280s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.032s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00292e13-61f9-4258-ab64-a1a30b45c739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3975b30-8cd8-419b-8da2-8ee54848cd61', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5977049-b373-418e-a6d9-f179e56d97b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:49 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Volume volume-d3975b30-8cd8-419b-8da2-8ee54848cd61 (d3975b30-8cd8-419b-8da2-8ee54848cd61): created successfully
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5977049-b373-418e-a6d9-f179e56d97b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Flow 'volume_create_manager' (b3ec6201-8635-4048-9240-8471f08a593b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] Creating offline snapshot 48da293a-21a3-47d6-acd6-89b330380394 of volume 924e1f86-a527-4155-8f19-edac8ef68319 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 03:59:49 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e1a0390d-f03b-45da-ad46-a998d8fc9150 tempest-VolumesListTestJSON-1577981898 None] Created volume successfully.
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[2630e0ab-9db6-499b-904e-36c4355b175a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:59:49 devstack sudo[97957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319
Sep 09 03:59:49 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (5e84cfc2-691f-4710-9a54-621fdc82f529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc0e90a-4b9a-4de3-bf85-01e81c395602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc0e90a-4b9a-4de3-bf85-01e81c395602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1491909316',display_name='tempest-VolumesGetTest-Volume-470620977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12362b81-28a7-417e-8954-c6300d9f5b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee11c10f2a24def80d77cf6abebb6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:49Z,use_quota=True,user_id='8af7a3b9e1224933811ace51a425e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ee90c8-a615-4afc-91d3-25eec11dfb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ee90c8-a615-4afc-91d3-25eec11dfb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661e223e-de27-498e-83a6-1411260edec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661e223e-de27-498e-83a6-1411260edec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12362b81-28a7-417e-8954-c6300d9f5b33', 'volume_name': 'volume-12362b81-28a7-417e-8954-c6300d9f5b33', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afc119f-3c9e-49ca-9a0e-4ea7c3a2b6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afc119f-3c9e-49ca-9a0e-4ea7c3a2b6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa129722-ad8e-48b3-b504-6f04f0b23ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:49 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Volume 12362b81-28a7-417e-8954-c6300d9f5b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12362b81-28a7-417e-8954-c6300d9f5b33', 'volume_size': 1}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:49 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319" returned: 0 in 0.436s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:49 devstack sudo[97964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394 1G
Sep 09 03:59:49 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:50 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394 1G" returned: 0 in 0.406s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924e1f86-a527-4155-8f19-edac8ef68319 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:50 devstack sudo[97970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924e1f86-a527-4155-8f19-edac8ef68319 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394
Sep 09 03:59:50 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:50 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924e1f86-a527-4155-8f19-edac8ef68319 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394" returned: 0 in 0.332s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:50 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394 is being set with open permissions: ugo+rw
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:50 devstack sudo[97975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394
Sep 09 03:59:50 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Flow 'volume_create_manager' (c03b8a77-e7ba-4055-91ae-23581a893301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf012bd-a2c8-48c8-bc43-1a9f07443591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf012bd-a2c8-48c8-bc43-1a9f07443591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-13502369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a42765b-2e1d-4767-bb98-773e9438c453,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a09c06abae6c43a8a8be61dc09a2d0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:50Z,use_quota=True,user_id='5dd2199395b84328950eddbcb96e12f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806f00e9-18ce-4773-bbe8-384f58b65a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806f00e9-18ce-4773-bbe8-384f58b65a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018a9861-817c-45b4-b8e2-bc0d023fa937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018a9861-817c-45b4-b8e2-bc0d023fa937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a42765b-2e1d-4767-bb98-773e9438c453', 'volume_name': 'volume-7a42765b-2e1d-4767-bb98-773e9438c453', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a152167-7927-4b40-ba98-a21d866e5ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a152167-7927-4b40-ba98-a21d866e5ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6bc455-419d-41fb-abf1-51eb34aa24a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:50 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Volume 7a42765b-2e1d-4767-bb98-773e9438c453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a42765b-2e1d-4767-bb98-773e9438c453', 'volume_size': 1}
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:50 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394" returned: 0 in 0.250s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:50 devstack sudo[97978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.info
Sep 09 03:59:50 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:50 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.info" returned: 0 in 0.244s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:50 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.info is being set with open permissions: ugo+rw
Sep 09 03:59:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:50 devstack sudo[97981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.info
Sep 09 03:59:50 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:51 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.info" returned: 0 in 0.235s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.756s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1491909316',display_name='tempest-VolumesGetTest-Volume-470620977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12362b81-28a7-417e-8954-c6300d9f5b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee11c10f2a24def80d77cf6abebb6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:49Z,use_quota=True,user_id='8af7a3b9e1224933811ace51a425e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Creating volume 12362b81-28a7-417e-8954-c6300d9f5b33 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:59:51 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-12362b81-28a7-417e-8954-c6300d9f5b33 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:51 devstack sudo[97984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-12362b81-28a7-417e-8954-c6300d9f5b33 1073741824
Sep 09 03:59:51 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ec0ce295-06e9-4834-8a38-1a72f2a12097 tempest-SnapshotDependencyTests-191865138 None] Create snapshot completed successfully
Sep 09 03:59:51 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-12362b81-28a7-417e-8954-c6300d9f5b33 1073741824" returned: 0 in 0.419s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-12362b81-28a7-417e-8954-c6300d9f5b33 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:51 devstack sudo[97989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-12362b81-28a7-417e-8954-c6300d9f5b33
Sep 09 03:59:51 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:51 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-12362b81-28a7-417e-8954-c6300d9f5b33" returned: 0 in 0.245s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.300s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-13502369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a42765b-2e1d-4767-bb98-773e9438c453,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a09c06abae6c43a8a8be61dc09a2d0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:50Z,use_quota=True,user_id='5dd2199395b84328950eddbcb96e12f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Creating volume 7a42765b-2e1d-4767-bb98-773e9438c453 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:59:51 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7a42765b-2e1d-4767-bb98-773e9438c453 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa129722-ad8e-48b3-b504-6f04f0b23ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12362b81-28a7-417e-8954-c6300d9f5b33', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:51 devstack sudo[97992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7a42765b-2e1d-4767-bb98-773e9438c453 1073741824
Sep 09 03:59:51 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc09fe1-2da3-41de-b184-ef947ac7ba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:51 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Volume volume-12362b81-28a7-417e-8954-c6300d9f5b33 (12362b81-28a7-417e-8954-c6300d9f5b33): created successfully
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc09fe1-2da3-41de-b184-ef947ac7ba0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (5e84cfc2-691f-4710-9a54-621fdc82f529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b48e37b4-9b31-435d-8e86-854c5a92c94d tempest-VolumesGetTest-1866198425 None] Created volume successfully.
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 03:59:52 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Flow 'volume_create_manager' (6247b325-42b7-4b23-a5ea-0c457d52fb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9939a86c-e7d3-4be7-b1f0-434455e9f0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7a42765b-2e1d-4767-bb98-773e9438c453 1073741824" returned: 0 in 0.482s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9939a86c-e7d3-4be7-b1f0-434455e9f0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T01:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16da01eb-8792-4c28-b27b-bd422c66a57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ddd164fbfe34714a044498d32b9fd1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=48da293a-21a3-47d6-acd6-89b330380394,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:52Z,use_quota=True,user_id='489ea01b64df456aba23b74b2c019140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41758d08-1f4a-4078-b7c7-98c22be69790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41758d08-1f4a-4078-b7c7-98c22be69790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d980ed-12bc-415f-aa30-1de72a17d4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d980ed-12bc-415f-aa30-1de72a17d4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16da01eb-8792-4c28-b27b-bd422c66a57f', 'volume_name': 'volume-16da01eb-8792-4c28-b27b-bd422c66a57f', 'volume_size': 1, 'snapshot_id': '48da293a-21a3-47d6-acd6-89b330380394'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ceca0f-8f93-4563-b1a2-8fa336bf7c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ceca0f-8f93-4563-b1a2-8fa336bf7c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c58925-539d-4782-ba63-7a130b69bc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:52 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Volume 16da01eb-8792-4c28-b27b-bd422c66a57f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16da01eb-8792-4c28-b27b-bd422c66a57f', 'volume_size': 1, 'snapshot_id': '48da293a-21a3-47d6-acd6-89b330380394'}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7a42765b-2e1d-4767-bb98-773e9438c453 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:52 devstack sudo[97999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7a42765b-2e1d-4767-bb98-773e9438c453
Sep 09 03:59:52 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-12362b81-28a7-417e-8954-c6300d9f5b33-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Lock "cinder-12362b81-28a7-417e-8954-c6300d9f5b33-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-quobyte-12362b81-28a7-417e-8954-c6300d9f5b33" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-12362b81-28a7-417e-8954-c6300d9f5b33" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03741a4-41ef-45e2-bf0a-d6452e6a9eac]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-12362b81-28a7-417e-8954-c6300d9f5b33 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:52 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7a42765b-2e1d-4767-bb98-773e9438c453" returned: 0 in 0.287s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.306s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "cinder-quobyte-48da293a-21a3-47d6-acd6-89b330380394-16da01eb-8792-4c28-b27b-bd422c66a57f" by "_create_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6bc455-419d-41fb-abf1-51eb34aa24a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a42765b-2e1d-4767-bb98-773e9438c453', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a122897-ea04-4ec6-bcf2-122bdac089a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-quobyte-48da293a-21a3-47d6-acd6-89b330380394-16da01eb-8792-4c28-b27b-bd422c66a57f" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Creating volume 16da01eb-8792-4c28-b27b-bd422c66a57f from snapshot 48da293a-21a3-47d6-acd6-89b330380394 {{(pid=87558) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "cinder-quobyte-16da01eb-8792-4c28-b27b-bd422c66a57f" by "_copy_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:52 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Volume volume-7a42765b-2e1d-4767-bb98-773e9438c453 (7a42765b-2e1d-4767-bb98-773e9438c453): created successfully
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a122897-ea04-4ec6-bcf2-122bdac089a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Flow 'volume_create_manager' (c03b8a77-e7ba-4055-91ae-23581a893301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-quobyte-16da01eb-8792-4c28-b27b-bd422c66a57f" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] snapshot: 48da293a-21a3-47d6-acd6-89b330380394, volume: 16da01eb-8792-4c28-b27b-bd422c66a57f,  {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 03:59:52 devstack sudo[98008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-12362b81-28a7-417e-8954-c6300d9f5b33
Sep 09 03:59:52 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:52 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-048c3583-ba3d-4f40-bfdc-3ef8a75ce4f2 tempest-VolumesListTestJSON-1577981898 None] Created volume successfully.
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0193518f-b277-4fc7-883d-4754e694f50a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:52 devstack sudo[98013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394
Sep 09 03:59:52 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:53 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-12362b81-28a7-417e-8954-c6300d9f5b33" returned: 0 in 0.408s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-12362b81-28a7-417e-8954-c6300d9f5b33 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:53 devstack sudo[98018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-12362b81-28a7-417e-8954-c6300d9f5b33
Sep 09 03:59:53 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:53 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394" returned: 0 in 0.412s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-924e1f86-a527-4155-8f19-edac8ef68319(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f0ec17-16bc-4191-8a3a-b9f6f6bea626]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:53 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-12362b81-28a7-417e-8954-c6300d9f5b33" returned: 0 in 0.270s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-12362b81-28a7-417e-8954-c6300d9f5b33" released by "delete_volume" :: held 0.722s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:53 devstack sudo[98023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319
Sep 09 03:59:53 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Created reservations ['da966a31-68dc-4023-8fb4-868b31cd417d', '9166523c-e9a0-4424-89c4-e4de0a4b4902', '75fb14da-35d2-402a-83b7-88aab8052c19', '19a409ed-d0bd-4acc-bd2e-107c18058803'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:53 devstack sudo[98026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:59:53 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:53 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319" returned: 0 in 0.418s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319 {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Creating direct copy from snapshot {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.utils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Path /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f not found in is_blk_device check {{(pid=87558) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:53 devstack sudo[98032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f
Sep 09 03:59:53 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:53 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.281s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:59:53 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Deleted volume successfully.
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-534736bf-a9a8-4871-9a0d-ed4d882681fd tempest-VolumesGetTest-1866198425 None] Lock "cinder-12362b81-28a7-417e-8954-c6300d9f5b33-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-2db6a954-37d8-4217-a404-f7ac10dce489-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Lock "cinder-2db6a954-37d8-4217-a404-f7ac10dce489-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-quobyte-2db6a954-37d8-4217-a404-f7ac10dce489" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-2db6a954-37d8-4217-a404-f7ac10dce489" acquired by "delete_volume" :: waited 0.022s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf147b3c-d5dc-4094-bb96-d43646046fba]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:54 devstack sudo[98035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489
Sep 09 03:59:54 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:54 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489" returned: 0 in 0.556s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:54 devstack sudo[98050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489
Sep 09 03:59:54 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:55 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2db6a954-37d8-4217-a404-f7ac10dce489" returned: 0 in 0.511s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-2db6a954-37d8-4217-a404-f7ac10dce489" released by "delete_volume" :: held 1.140s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:55 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Created reservations ['0c3561c5-fcf2-453e-ba85-aec6c609da16', 'dcab0b73-28f3-49e0-976a-8602d4befd01', '3b9be0d6-a4d3-4171-b4b2-3bacb446c14d', '78bf2122-2212-47cd-959b-3474b0a5d14a'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:59:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:55 devstack sudo[98054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:59:55 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:55 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.398s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:55 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:59:55 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Deleted volume successfully.
Sep 09 03:59:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6e5de0ab-e22d-44a7-bb96-fbe0553e7f63 tempest-VolumesGetTest-1866198425 None] Lock "cinder-2db6a954-37d8-4217-a404-f7ac10dce489-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-6b04ca59-7554-4466-8054-13f0950ce6e2-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Lock "cinder-6b04ca59-7554-4466-8054-13f0950ce6e2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-quobyte-6b04ca59-7554-4466-8054-13f0950ce6e2" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-6b04ca59-7554-4466-8054-13f0950ce6e2" acquired by "delete_volume" :: waited 0.046s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:56 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c216b12-dc4a-4eb2-8661-0934cf43c740]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:56 devstack sudo[98057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2
Sep 09 03:59:56 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:57 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2" returned: 0 in 0.809s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:57 devstack sudo[98062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2
Sep 09 03:59:57 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "cinder-7a42765b-2e1d-4767-bb98-773e9438c453-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Lock "cinder-7a42765b-2e1d-4767-bb98-773e9438c453-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "cinder-quobyte-7a42765b-2e1d-4767-bb98-773e9438c453" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 03:59:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Lock "cinder-quobyte-7a42765b-2e1d-4767-bb98-773e9438c453" acquired by "delete_volume" :: waited 0.039s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 03:59:58 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6b04ca59-7554-4466-8054-13f0950ce6e2" returned: 0 in 0.513s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:58 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[47834811-e68a-4fc1-a25a-393e000061e5]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 03:59:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7a42765b-2e1d-4767-bb98-773e9438c453 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-6b04ca59-7554-4466-8054-13f0950ce6e2" released by "delete_volume" :: held 1.609s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:58 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Created reservations ['775a68e7-d998-4784-a001-37296b764b6e', '7c962b84-d14f-4083-a12c-69b4125a3141', 'caafc40c-58ac-413b-8476-4c725a8d8b96', 'fbbdef63-870e-4a8c-a98d-46c90ac5ac93'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 03:59:58 devstack sudo[98065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7a42765b-2e1d-4767-bb98-773e9438c453
Sep 09 03:59:58 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 03:59:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 03:59:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 03:59:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 03:59:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 03:59:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:58 devstack sudo[98067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 03:59:58 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:59 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7a42765b-2e1d-4767-bb98-773e9438c453" returned: 0 in 1.371s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7a42765b-2e1d-4767-bb98-773e9438c453 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:59 devstack sudo[98073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7a42765b-2e1d-4767-bb98-773e9438c453
Sep 09 03:59:59 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:59 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.999s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:59 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 03:59:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Deleted volume successfully.
Sep 09 03:59:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3d5d6c23-6922-4a9d-9398-387e50cf9b05 tempest-VolumesGetTest-1866198425 None] Lock "cinder-6b04ca59-7554-4466-8054-13f0950ce6e2-delete_volume" released by "delete_volume" :: held 3.309s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:59 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f" returned: 0 in 6.037s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:59 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 03:59:59 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Converted 1024.00 MB image at 169.58 MB/s
Sep 09 03:59:59 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f is being set with open permissions: ugo+rw
Sep 09 03:59:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 03:59:59 devstack sudo[98076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f
Sep 09 03:59:59 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 03:59:59 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root
Sep 09 03:59:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7a42765b-2e1d-4767-bb98-773e9438c453" returned: 0 in 0.409s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 03:59:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Lock "cinder-quobyte-7a42765b-2e1d-4767-bb98-773e9438c453" released by "delete_volume" :: held 1.925s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 03:59:59 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Created reservations ['84f2836a-d9e1-45db-9671-88093065eb38', '916569b9-9b8c-47ea-93d6-b1c5b95d017a', 'b9e1b5ec-3352-4546-af8c-2ab321536081', 'c505763f-44df-4efc-8424-898af5534666'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:00 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f" returned: 0 in 0.293s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-quobyte-16da01eb-8792-4c28-b27b-bd422c66a57f" released by "_copy_volume_from_snapshot" :: held 7.269s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:00 devstack sudo[98082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:00:00 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-quobyte-48da293a-21a3-47d6-acd6-89b330380394-16da01eb-8792-4c28-b27b-bd422c66a57f" released by "_create_volume_from_snapshot" :: held 7.373s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.414s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c58925-539d-4782-ba63-7a130b69bc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16da01eb-8792-4c28-b27b-bd422c66a57f', 'volume_size': 1, 'snapshot_id': '48da293a-21a3-47d6-acd6-89b330380394'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306421b6-7493-43a1-9613-96c360bef2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:00 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Volume volume-16da01eb-8792-4c28-b27b-bd422c66a57f (16da01eb-8792-4c28-b27b-bd422c66a57f): created successfully
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306421b6-7493-43a1-9613-96c360bef2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Flow 'volume_create_manager' (6247b325-42b7-4b23-a5ea-0c457d52fb81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:00 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-940e48c1-e2ab-421d-b04f-b6332dbe15b9 tempest-SnapshotDependencyTests-191865138 None] Created volume successfully.
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (59a6668e-cb71-457f-88c0-d622cc145ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8599306d-9b75-4620-abfe-2206319b72d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8599306d-9b75-4620-abfe-2206319b72d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-312138160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a60b2b8-92f7-4734-a76d-14b8032a37b2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fee11c10f2a24def80d77cf6abebb6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:00Z,use_quota=True,user_id='8af7a3b9e1224933811ace51a425e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:00 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66279da7-9d20-4ea7-8936-8ac309f5634a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66279da7-9d20-4ea7-8936-8ac309f5634a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8cc151d-8bf1-4714-bf3e-afe64199bda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.image.glance [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Creating Keystone auth plugin from conf {{(pid=87558) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.464s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:00:00 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Deleted volume successfully.
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "cinder-d3975b30-8cd8-419b-8da2-8ee54848cd61-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "cinder-48da293a-21a3-47d6-acd6-89b330380394-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Lock "cinder-d3975b30-8cd8-419b-8da2-8ee54848cd61-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-48da293a-21a3-47d6-acd6-89b330380394-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "cinder-quobyte-924e1f86-a527-4155-8f19-edac8ef68319" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2c029d79-e59f-4011-96a8-a4cb8163d4b1 tempest-VolumesListTestJSON-1577981898 None] Lock "cinder-7a42765b-2e1d-4767-bb98-773e9438c453-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-quobyte-924e1f86-a527-4155-8f19-edac8ef68319" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "cinder-quobyte-48da293a-21a3-47d6-acd6-89b330380394" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "cinder-quobyte-d3975b30-8cd8-419b-8da2-8ee54848cd61" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-quobyte-48da293a-21a3-47d6-acd6-89b330380394" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Deleting offline snapshot 48da293a-21a3-47d6-acd6-89b330380394 of volume 924e1f86-a527-4155-8f19-edac8ef68319 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] snapshot_file for this snap is: volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Lock "cinder-quobyte-d3975b30-8cd8-419b-8da2-8ee54848cd61" acquired by "delete_volume" :: waited 0.061s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd14812c-0f6b-4ce1-83eb-2ac8fbdd604c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0c12df-02e9-4607-9cc6-6ae3fbbada01]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3975b30-8cd8-419b-8da2-8ee54848cd61 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:00 devstack sudo[98088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3975b30-8cd8-419b-8da2-8ee54848cd61
Sep 09 04:00:00 devstack sudo[98085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394
Sep 09 04:00:00 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:00 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8cc151d-8bf1-4714-bf3e-afe64199bda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a60b2b8-92f7-4734-a76d-14b8032a37b2', 'volume_name': 'volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01b4d70>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a4ed9b-03da-4320-a1b6-cd4d8e96c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a4ed9b-03da-4320-a1b6-cd4d8e96c653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce9f8c8-8850-4433-9c11-0d2cbb49dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:01 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Volume 5a60b2b8-92f7-4734-a76d-14b8032a37b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01b4d70>}
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Trying to clone 5a60b2b8-92f7-4734-a76d-14b8032a37b2 from image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]). {{(pid=87558) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 04:00:01 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:01 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3975b30-8cd8-419b-8da2-8ee54848cd61" returned: 0 in 0.610s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3975b30-8cd8-419b-8da2-8ee54848cd61 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394" returned: 0 in 0.662s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:01 devstack sudo[98119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3975b30-8cd8-419b-8da2-8ee54848cd61
Sep 09 04:00:01 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-924e1f86-a527-4155-8f19-edac8ef68319(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edb20ef-685d-4329-b330-c78d79b664c6]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:01 devstack sudo[98121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319
Sep 09 04:00:01 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:01 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3975b30-8cd8-419b-8da2-8ee54848cd61" returned: 0 in 0.471s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 04:00:01 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Image download 20.69 MB at 20.69 MB/s
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Lock "cinder-quobyte-d3975b30-8cd8-419b-8da2-8ee54848cd61" released by "delete_volume" :: held 1.180s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Created reservations ['424e859a-c931-4de6-84a5-a5a02eb045cd', '4b30646d-740f-45f8-8033-e83b4f2b9741', '719b268c-e785-47e0-ae78-af320ab61b43', '79ceb6f2-7b9f-44e8-a8c9-2e246af6f935'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1903faa6-c2a2-4ab2-9999-1fe4fdab33ac]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:02 devstack sudo[98128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD
Sep 09 04:00:02 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:02 devstack sudo[98131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:00:02 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:02 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319" returned: 0 in 0.881s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:02 devstack sudo[98134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394
Sep 09 04:00:02 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:02 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD" returned: 0 in 0.569s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Temporary image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 is fetched for user 8af7a3b9e1224933811ace51a425e8ff. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 04:00:02 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.413s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:00:02 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Deleted volume successfully.
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7d17b1b2-1937-4653-a15f-0dcec45cdf8f tempest-VolumesListTestJSON-1577981898 None] Lock "cinder-d3975b30-8cd8-419b-8da2-8ee54848cd61-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb4570b-32bc-4be5-88fb-30b408af9806]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:02 devstack sudo[98143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD
Sep 09 04:00:02 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:02 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394" returned: 0 in 0.574s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:02 devstack sudo[98148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394
Sep 09 04:00:02 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "cinder-f4226133-a57d-444b-9e3c-d92cc4f6dcef-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Lock "cinder-f4226133-a57d-444b-9e3c-d92cc4f6dcef-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:03 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-312138160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a60b2b8-92f7-4734-a76d-14b8032a37b2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fee11c10f2a24def80d77cf6abebb6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:00Z,use_quota=True,user_id='8af7a3b9e1224933811ace51a425e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Creating volume 5a60b2b8-92f7-4734-a76d-14b8032a37b2 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:00:03 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "cinder-quobyte-f4226133-a57d-444b-9e3c-d92cc4f6dcef" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:03 devstack sudo[98154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2 1073741824
Sep 09 04:00:03 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Lock "cinder-quobyte-f4226133-a57d-444b-9e3c-d92cc4f6dcef" acquired by "delete_volume" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c99c9e-2112-4f50-8fcf-b4e94337ce30]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:03 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319.48da293a-21a3-47d6-acd6-89b330380394" returned: 0 in 0.387s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-quobyte-48da293a-21a3-47d6-acd6-89b330380394" released by "_delete_snapshot" :: held 2.705s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:03 devstack sudo[98156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef
Sep 09 04:00:03 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-quobyte-924e1f86-a527-4155-8f19-edac8ef68319" released by "delete_snapshot" :: held 2.743s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Created reservations ['bd921ce9-67b8-446f-90ac-33b10ba68b75', '7b6ffef0-6028-4c77-b125-c31679910a13', 'e6aef42d-db44-4dda-8e1b-19e530af4376', 'f2abd936-fe71-4c59-9387-e55b6275e08c'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:03 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Delete snapshot completed successfully.
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f6b23b21-fb08-4103-93e4-4411786a186e tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-48da293a-21a3-47d6-acd6-89b330380394-delete_snapshot" released by "delete_snapshot" :: held 2.963s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:03 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:03 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef" returned: 0 in 0.431s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2 1073741824" returned: 0 in 0.523s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:03 devstack sudo[98167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef
Sep 09 04:00:03 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:03 devstack sudo[98169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2
Sep 09 04:00:03 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "cinder-924e1f86-a527-4155-8f19-edac8ef68319-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-924e1f86-a527-4155-8f19-edac8ef68319-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "cinder-quobyte-924e1f86-a527-4155-8f19-edac8ef68319" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-quobyte-924e1f86-a527-4155-8f19-edac8ef68319" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4da394d-fe98-4dad-b5b7-5e7628fcb4cd]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:03 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f4226133-a57d-444b-9e3c-d92cc4f6dcef" returned: 0 in 0.353s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Lock "cinder-quobyte-f4226133-a57d-444b-9e3c-d92cc4f6dcef" released by "delete_volume" :: held 0.843s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:04 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2" returned: 0 in 0.330s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Attempting download of 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}])) to volume 5a60b2b8-92f7-4734-a76d-14b8032a37b2. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Created reservations ['2148c400-3cb4-49f7-bb4c-4e665c32ef69', '71e5eacd-3019-4f9c-8b17-ce54348075e6', '345f55d1-59e3-4462-9549-ebaff8cf2660', '5d1c83c8-999a-467f-9a3a-50dd9cf25364'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:04 devstack sudo[98173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319
Sep 09 04:00:04 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[404f10f0-fdda-4254-bbff-55ede83ae17d]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_djta2epu {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:04 devstack sudo[98176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:00:04 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:04 devstack sudo[98175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_djta2epu
Sep 09 04:00:04 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:04 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319" returned: 0 in 0.450s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:04 devstack sudo[98182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319
Sep 09 04:00:04 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:04 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.281s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:00:04 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Deleted volume successfully.
Sep 09 04:00:04 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_djta2epu" returned: 0 in 0.377s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_djta2epu {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-77d28fc7-ab08-41ef-b96a-b60b0215edbe tempest-VolumesListTestJSON-1577981898 None] Lock "cinder-f4226133-a57d-444b-9e3c-d92cc4f6dcef-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:04 devstack sudo[98187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_djta2epu
Sep 09 04:00:04 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:04 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-924e1f86-a527-4155-8f19-edac8ef68319" returned: 0 in 0.415s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-quobyte-924e1f86-a527-4155-8f19-edac8ef68319" released by "delete_volume" :: held 0.947s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:04 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Created reservations ['276d964e-38b2-4e01-b428-8692ce5c0840', '5da489f5-f329-44c1-8c4a-28786baac437', '0f4aef82-b7e3-4a0b-9fe5-4cfb049abf73', 'd5ff1cd8-2571-4ac2-9277-926eee9b7525'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Acquiring lock "cinder-852e8615-d20a-4589-962a-f812c3e94465-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:05 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Lock "cinder-852e8615-d20a-4589-962a-f812c3e94465-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_djta2epu" returned: 1 in 0.520s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_djta2epu' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6851e729-1706-41c2-95c5-dfa8d368a9d7]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Acquiring lock "cinder-quobyte-852e8615-d20a-4589-962a-f812c3e94465" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Lock "cinder-quobyte-852e8615-d20a-4589-962a-f812c3e94465" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:05 devstack sudo[98230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:00:05 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bd7312-5b54-4612-9f46-ff286240f4f6]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-852e8615-d20a-4589-962a-f812c3e94465 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:05 devstack sudo[98229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD
Sep 09 04:00:05 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:05 devstack sudo[98232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-852e8615-d20a-4589-962a-f812c3e94465
Sep 09 04:00:05 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:05 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.272s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:00:05 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Deleted volume successfully.
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-925daa96-0d5f-4d2d-9848-94269363ccd3 tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-924e1f86-a527-4155-8f19-edac8ef68319-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:05 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 was qcow2, converting to qcow2 {{(pid=87558) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:05 devstack sudo[98240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2
Sep 09 04:00:05 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:05 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-852e8615-d20a-4589-962a-f812c3e94465" returned: 0 in 0.421s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-852e8615-d20a-4589-962a-f812c3e94465 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:05 devstack sudo[98245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-852e8615-d20a-4589-962a-f812c3e94465
Sep 09 04:00:05 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:05 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-852e8615-d20a-4589-962a-f812c3e94465" returned: 0 in 0.300s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Lock "cinder-quobyte-852e8615-d20a-4589-962a-f812c3e94465" released by "delete_volume" :: held 0.767s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:05 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Created reservations ['39adb54b-f02e-4a4c-88be-6784a5f1ed7a', '6a64b41a-7906-4bec-afbe-286fee53ce5f', '945f60fb-1bf1-425e-b893-a12aefdd0fd9', 'bedc10b2-964a-4514-ad10-0daba0cb0ae6'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:06 devstack sudo[98255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:00:06 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "cinder-16da01eb-8792-4c28-b27b-bd422c66a57f-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-16da01eb-8792-4c28-b27b-bd422c66a57f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "cinder-quobyte-16da01eb-8792-4c28-b27b-bd422c66a57f" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-quobyte-16da01eb-8792-4c28-b27b-bd422c66a57f" acquired by "delete_volume" :: waited 0.043s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4040d4-746c-4f4e-a5b1-7f989b685243]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:06 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.353s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:00:06 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Deleted volume successfully.
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a77babc9-b7e3-4970-8e6f-ef1cec74a674 tempest-AttachVolumeShelveTestJSON-118742061 None] Lock "cinder-852e8615-d20a-4589-962a-f812c3e94465-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:06 devstack sudo[98257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f
Sep 09 04:00:06 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:06 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f" returned: 0 in 0.546s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:06 devstack sudo[98263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f
Sep 09 04:00:06 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:07 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-16da01eb-8792-4c28-b27b-bd422c66a57f" returned: 0 in 0.367s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-quobyte-16da01eb-8792-4c28-b27b-bd422c66a57f" released by "delete_volume" :: held 0.985s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Created reservations ['4da4ef85-f82c-4f88-92bb-e16596def38d', '41637bd0-a1c2-4418-8d00-9805d2cd102d', '750bdee7-16f2-49d6-9056-a1c0f6c4da89', '57c7a637-739d-4bee-9638-c7e21a84a804'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:07 devstack sudo[98266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:00:07 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:07 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2" returned: 0 in 2.257s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_e26tnqevdevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2 {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 04:00:07 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Converted 112.00 MB image at 49.59 MB/s
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:07 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.295s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:00:07 devstack sudo[98269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2 1G
Sep 09 04:00:07 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:07 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Deleted volume successfully.
Sep 09 04:00:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e90d187f-55c4-4e05-85d4-e7cc1e9894d6 tempest-SnapshotDependencyTests-191865138 None] Lock "cinder-16da01eb-8792-4c28-b27b-bd422c66a57f-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:08 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2 1G" returned: 0 in 0.369s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:08 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Downloaded image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}])) to volume 5a60b2b8-92f7-4734-a76d-14b8032a37b2 successfully. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 04:00:08 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Temporary image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 for user 8af7a3b9e1224933811ace51a425e8ff is deleted. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 04:00:08 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Marking volume 5a60b2b8-92f7-4734-a76d-14b8032a37b2 as bootable. {{(pid=87558) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 04:00:08 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Copying metadata from image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 to 5a60b2b8-92f7-4734-a76d-14b8032a37b2. {{(pid=87558) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 04:00:08 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Creating volume glance metadata for volume 5a60b2b8-92f7-4734-a76d-14b8032a37b2 backed by image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87558) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 04:00:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce9f8c8-8850-4433-9c11-0d2cbb49dba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01b4d70>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f9c1af-cbb6-42c2-b850-fb24d4315935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:08 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Volume volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2 (5a60b2b8-92f7-4734-a76d-14b8032a37b2): created successfully
Sep 09 04:00:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f9c1af-cbb6-42c2-b850-fb24d4315935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (59a6668e-cb71-457f-88c0-d622cc145ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:08 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-5d276f80-4c87-4085-b0fc-feaaed986214 tempest-VolumesGetTest-1866198425 None] Created volume successfully.
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (4e5a22c6-3134-4fe8-a85f-9275ca29f7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87362684-0d6d-4092-b4ff-c6c88d3e279e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87362684-0d6d-4092-b4ff-c6c88d3e279e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1959392499',display_name='tempest-VolumesGetTest-Volume-720758737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a19c28-9837-4f5b-8e3e-1098e3138bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee11c10f2a24def80d77cf6abebb6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:10Z,use_quota=True,user_id='8af7a3b9e1224933811ace51a425e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc01e478-7ab9-469e-9149-8689d1699436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc01e478-7ab9-469e-9149-8689d1699436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffd2a9d-c77a-48e5-bb7c-d346a0d6b531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffd2a9d-c77a-48e5-bb7c-d346a0d6b531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a19c28-9837-4f5b-8e3e-1098e3138bc1', 'volume_name': 'volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a86786-d1a7-4bbf-a263-4aa92d3e7ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a86786-d1a7-4bbf-a263-4aa92d3e7ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ce84aa-5946-4270-b203-c4822070a0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:09 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Volume b1a19c28-9837-4f5b-8e3e-1098e3138bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1', 'volume_size': 1}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1959392499',display_name='tempest-VolumesGetTest-Volume-720758737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a19c28-9837-4f5b-8e3e-1098e3138bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee11c10f2a24def80d77cf6abebb6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:10Z,use_quota=True,user_id='8af7a3b9e1224933811ace51a425e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Creating volume b1a19c28-9837-4f5b-8e3e-1098e3138bc1 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:00:09 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:00:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:10 devstack sudo[98276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1 1073741824
Sep 09 04:00:10 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:10 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1 1073741824" returned: 0 in 0.553s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:10 devstack sudo[98283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1
Sep 09 04:00:10 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:10 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1" returned: 0 in 0.320s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:00:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ce84aa-5946-4270-b203-c4822070a0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51b8c84-a4b1-4a91-a3e2-2d181487983f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:10 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Volume volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1 (b1a19c28-9837-4f5b-8e3e-1098e3138bc1): created successfully
Sep 09 04:00:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51b8c84-a4b1-4a91-a3e2-2d181487983f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Flow 'volume_create_manager' (4e5a22c6-3134-4fe8-a85f-9275ca29f7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:10 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-432946a9-1c5f-4ef2-9db1-86a594c4ada8 tempest-VolumesGetTest-1866198425 None] Created volume successfully.
Sep 09 04:00:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-b1a19c28-9837-4f5b-8e3e-1098e3138bc1-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Lock "cinder-b1a19c28-9837-4f5b-8e3e-1098e3138bc1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-quobyte-b1a19c28-9837-4f5b-8e3e-1098e3138bc1" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-b1a19c28-9837-4f5b-8e3e-1098e3138bc1" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:12 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1b9cf2-7c59-41a2-bd77-dbd9af1485f8]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:12 devstack sudo[98287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1
Sep 09 04:00:12 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:12 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1" returned: 0 in 0.411s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:12 devstack sudo[98292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1
Sep 09 04:00:12 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:12 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b1a19c28-9837-4f5b-8e3e-1098e3138bc1" returned: 0 in 0.264s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-b1a19c28-9837-4f5b-8e3e-1098e3138bc1" released by "delete_volume" :: held 0.728s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Created reservations ['0ae9b7c7-ae05-421f-9c25-62bfc3d7fba0', '09a1f5d4-2376-485a-a413-01adbd3f7dae', '24e8a383-bbae-41b6-8a7a-b5bdb52bd3d2', 'cf1d4876-0781-4dde-aa40-9da0ee556610'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:13 devstack sudo[98295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:00:13 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:13 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.249s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:00:13 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Deleted volume successfully.
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d689d6d4-9ccd-411a-b88e-167ce6e33f1b tempest-VolumesGetTest-1866198425 None] Lock "cinder-b1a19c28-9837-4f5b-8e3e-1098e3138bc1-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-5a60b2b8-92f7-4734-a76d-14b8032a37b2-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Lock "cinder-5a60b2b8-92f7-4734-a76d-14b8032a37b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Acquiring lock "cinder-quobyte-5a60b2b8-92f7-4734-a76d-14b8032a37b2" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-5a60b2b8-92f7-4734-a76d-14b8032a37b2" acquired by "delete_volume" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf251b1c-2713-42e7-b91f-79878598dbff]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:13 devstack sudo[98298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2
Sep 09 04:00:13 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2" returned: 0 in 0.471s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:14 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:14 devstack sudo[98304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2
Sep 09 04:00:14 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:14 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5a60b2b8-92f7-4734-a76d-14b8032a37b2" returned: 0 in 0.376s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Lock "cinder-quobyte-5a60b2b8-92f7-4734-a76d-14b8032a37b2" released by "delete_volume" :: held 0.902s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:14 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Created reservations ['6861b0c9-ee85-4197-92c2-e6a224c4b839', '7e6819de-4854-47cd-b34d-e5dd8cdfa1d6', 'b71c729c-65b7-4751-8ee0-d676617046f1', '3d9aa584-7829-43b2-98c2-10c86fe6240c'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:14 devstack sudo[98308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:00:14 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:14 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.325s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:14 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:00:15 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Deleted volume successfully.
Sep 09 04:00:15 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a97ae704-1b7b-4e0c-913c-219c0e41046f tempest-VolumesGetTest-1866198425 None] Lock "cinder-5a60b2b8-92f7-4734-a76d-14b8032a37b2-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Flow 'volume_create_manager' (927b2472-21bd-4a6f-98ab-29e4d0fefa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858522c2-0578-4d11-afed-e3b707a8bbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858522c2-0578-4d11-afed-e3b707a8bbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1000974826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f9f33b-e30b-4f34-8d02-336686a15da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea88e3c505a41189845751180d91742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:20Z,use_quota=True,user_id='13bf5808a2f64512ad3498d234b2366c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8e371b-9070-4892-9177-ad8713f1f617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8e371b-9070-4892-9177-ad8713f1f617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c9ff3d-90f9-4eca-8a1a-9ac659a344a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c9ff3d-90f9-4eca-8a1a-9ac659a344a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f9f33b-e30b-4f34-8d02-336686a15da0', 'volume_name': 'volume-d8f9f33b-e30b-4f34-8d02-336686a15da0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878d3525-dd2e-42ca-8cc3-58f6e81beb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878d3525-dd2e-42ca-8cc3-58f6e81beb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a18c6d2-72eb-411a-99d9-1e281ed36c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:20 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Volume d8f9f33b-e30b-4f34-8d02-336686a15da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f9f33b-e30b-4f34-8d02-336686a15da0', 'volume_size': 1}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1000974826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f9f33b-e30b-4f34-8d02-336686a15da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea88e3c505a41189845751180d91742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:20Z,use_quota=True,user_id='13bf5808a2f64512ad3498d234b2366c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Creating volume d8f9f33b-e30b-4f34-8d02-336686a15da0 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:00:20 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:20 devstack sudo[98314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0 1073741824
Sep 09 04:00:20 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:20 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0 1073741824" returned: 0 in 0.593s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:20 devstack sudo[98320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0
Sep 09 04:00:20 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:21 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0" returned: 0 in 0.395s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:00:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a18c6d2-72eb-411a-99d9-1e281ed36c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f9f33b-e30b-4f34-8d02-336686a15da0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3133cae-ac0b-43ef-a4a3-640a2e1dfea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:21 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Volume volume-d8f9f33b-e30b-4f34-8d02-336686a15da0 (d8f9f33b-e30b-4f34-8d02-336686a15da0): created successfully
Sep 09 04:00:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3133cae-ac0b-43ef-a4a3-640a2e1dfea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Flow 'volume_create_manager' (927b2472-21bd-4a6f-98ab-29e4d0fefa32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:21 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ac4aa8de-a292-4759-9bde-31a02bb570eb tempest-VolumesSnapshotTestJSON-1921432256 None] Created volume successfully.
Sep 09 04:00:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:22 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] Creating offline snapshot 6e3567ac-0777-421b-9a3e-55db9aa77726 of volume d8f9f33b-e30b-4f34-8d02-336686a15da0 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:00:22 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdc1577-3ea8-4f79-b175-4cb709696b08]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:23 devstack sudo[98323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0
Sep 09 04:00:23 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Flow 'volume_create_manager' (5e91c9da-a3f8-448e-bb3d-a8836aa70e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c0476c-bc7d-418b-8376-7eef2a843b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c0476c-bc7d-418b-8376-7eef2a843b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-13992463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc2465f-79bd-4b4b-b9a5-255df1593745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95e35ba82db4639916d4efd0d1af901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:23Z,use_quota=True,user_id='5b74f988dc6b4dbf942a6943df26aa4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0415a2b3-1291-49b6-9559-9ba70346bd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0415a2b3-1291-49b6-9559-9ba70346bd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2899a1-1039-4662-a7a8-9df7deff516d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2899a1-1039-4662-a7a8-9df7deff516d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fc2465f-79bd-4b4b-b9a5-255df1593745', 'volume_name': 'volume-8fc2465f-79bd-4b4b-b9a5-255df1593745', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14b99a3-84b0-4835-a3d7-c3459698cf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14b99a3-84b0-4835-a3d7-c3459698cf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06034908-a5a1-4609-a6d3-788c7b6c3dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:23 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Volume 8fc2465f-79bd-4b4b-b9a5-255df1593745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fc2465f-79bd-4b4b-b9a5-255df1593745', 'volume_size': 1}
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:23 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0" returned: 0 in 0.443s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:23 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726 1G
Sep 09 04:00:23 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:23 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726 1G" returned: 0 in 0.560s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f9f33b-e30b-4f34-8d02-336686a15da0 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:23 devstack sudo[98341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f9f33b-e30b-4f34-8d02-336686a15da0 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726
Sep 09 04:00:23 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:24 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f9f33b-e30b-4f34-8d02-336686a15da0 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726" returned: 0 in 0.368s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:24 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726 is being set with open permissions: ugo+rw
Sep 09 04:00:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:24 devstack sudo[98347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726
Sep 09 04:00:24 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:24 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726" returned: 0 in 0.260s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:24 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.info
Sep 09 04:00:24 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:24 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.info" returned: 0 in 0.280s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:24 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.info is being set with open permissions: ugo+rw
Sep 09 04:00:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:24 devstack sudo[98353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.info
Sep 09 04:00:24 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:25 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.info" returned: 0 in 0.279s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.323s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.881s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-13992463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc2465f-79bd-4b4b-b9a5-255df1593745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95e35ba82db4639916d4efd0d1af901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:23Z,use_quota=True,user_id='5b74f988dc6b4dbf942a6943df26aa4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Creating volume 8fc2465f-79bd-4b4b-b9a5-255df1593745 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:00:25 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8fc2465f-79bd-4b4b-b9a5-255df1593745 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:25 devstack sudo[98357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8fc2465f-79bd-4b4b-b9a5-255df1593745 1073741824
Sep 09 04:00:25 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-785c0cca-687e-487c-9f1c-e243f07e74a0 tempest-VolumesSnapshotTestJSON-1921432256 None] Create snapshot completed successfully
Sep 09 04:00:25 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8fc2465f-79bd-4b4b-b9a5-255df1593745 1073741824" returned: 0 in 0.582s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8fc2465f-79bd-4b4b-b9a5-255df1593745 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:25 devstack sudo[98363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8fc2465f-79bd-4b4b-b9a5-255df1593745
Sep 09 04:00:25 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-6e3567ac-0777-421b-9a3e-55db9aa77726-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-6e3567ac-0777-421b-9a3e-55db9aa77726-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-d8f9f33b-e30b-4f34-8d02-336686a15da0" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-d8f9f33b-e30b-4f34-8d02-336686a15da0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-6e3567ac-0777-421b-9a3e-55db9aa77726" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:26 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8fc2465f-79bd-4b4b-b9a5-255df1593745" returned: 0 in 0.450s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06034908-a5a1-4609-a6d3-788c7b6c3dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc2465f-79bd-4b4b-b9a5-255df1593745', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31539ad-e58b-4363-befb-fc9a6909eae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-6e3567ac-0777-421b-9a3e-55db9aa77726" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Deleting offline snapshot 6e3567ac-0777-421b-9a3e-55db9aa77726 of volume d8f9f33b-e30b-4f34-8d02-336686a15da0 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] snapshot_file for this snap is: volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:00:26 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Volume volume-8fc2465f-79bd-4b4b-b9a5-255df1593745 (8fc2465f-79bd-4b4b-b9a5-255df1593745): created successfully
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31539ad-e58b-4363-befb-fc9a6909eae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Flow 'volume_create_manager' (5e91c9da-a3f8-448e-bb3d-a8836aa70e18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[381c38c0-c361-497d-b59c-3748b95883e6]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:26 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-af8abcb0-e593-41b8-8890-442f9d445a59 tempest-VolumesNegativeTest-1421476637 None] Created volume successfully.
Sep 09 04:00:26 devstack sudo[98366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726
Sep 09 04:00:26 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:26 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726" returned: 0 in 0.405s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8f9f33b-e30b-4f34-8d02-336686a15da0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[af491771-96c0-43ab-95b2-7fc780f74dfb]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:26 devstack sudo[98372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0
Sep 09 04:00:26 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:27 devstack sudo[98374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:00:27 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:27 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0" returned: 0 in 0.401s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:27 devstack sudo[98379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726
Sep 09 04:00:27 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:27 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.333s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:00:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:00:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 04:00:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 04:00:27 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726" returned: 0 in 0.432s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:27 devstack sudo[98385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726
Sep 09 04:00:27 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:27 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0.6e3567ac-0777-421b-9a3e-55db9aa77726" returned: 0 in 0.305s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-6e3567ac-0777-421b-9a3e-55db9aa77726" released by "_delete_snapshot" :: held 1.708s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-d8f9f33b-e30b-4f34-8d02-336686a15da0" released by "delete_snapshot" :: held 1.755s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:28 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Created reservations ['2554b452-15e4-44f8-b08f-b64a189b529c', '750a25e1-c16f-4e67-b100-d08bdcdbd61f', 'ccec11b6-49d6-47df-8e51-f939944c45e6', '6aea7dfc-6f3e-45d0-a792-6e9869dbc358'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:28 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Delete snapshot completed successfully.
Sep 09 04:00:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f2b4becb-a299-4940-b15c-478fa8e488ec tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-6e3567ac-0777-421b-9a3e-55db9aa77726-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Flow 'volume_create_manager' (d68946a5-a627-41c8-aaa0-ea83e9d29627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b326d6-4bbc-4a23-8cee-da392fc2d483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b326d6-4bbc-4a23-8cee-da392fc2d483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1305828135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747b9e09-5b97-49e8-a8d4-ce9821b9c8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea88e3c505a41189845751180d91742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:29Z,use_quota=True,user_id='13bf5808a2f64512ad3498d234b2366c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd2ad44-5622-4838-aad4-d3d42d0e382c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd2ad44-5622-4838-aad4-d3d42d0e382c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0cf75a-4556-4a56-a4ae-25f621696f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0cf75a-4556-4a56-a4ae-25f621696f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747b9e09-5b97-49e8-a8d4-ce9821b9c8f0', 'volume_name': 'volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0710361e-b2f7-4648-802c-19928d7ee039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0710361e-b2f7-4648-802c-19928d7ee039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca399517-12ac-436e-b46c-05cc1887382f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:29 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Volume 747b9e09-5b97-49e8-a8d4-ce9821b9c8f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0', 'volume_size': 1}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1305828135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747b9e09-5b97-49e8-a8d4-ce9821b9c8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea88e3c505a41189845751180d91742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:29Z,use_quota=True,user_id='13bf5808a2f64512ad3498d234b2366c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Creating volume 747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:00:29 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:29 devstack sudo[98391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 1073741824
Sep 09 04:00:29 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:29 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 1073741824" returned: 0 in 0.609s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:29 devstack sudo[98397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0
Sep 09 04:00:29 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:30 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0" returned: 0 in 0.405s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:00:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca399517-12ac-436e-b46c-05cc1887382f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a477314-8c68-4960-a113-c33c4d7dea6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:30 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Volume volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 (747b9e09-5b97-49e8-a8d4-ce9821b9c8f0): created successfully
Sep 09 04:00:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a477314-8c68-4960-a113-c33c4d7dea6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Flow 'volume_create_manager' (d68946a5-a627-41c8-aaa0-ea83e9d29627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2e42335f-165a-4c92-9e4c-1042e65fe73a tempest-VolumesSnapshotTestJSON-1921432256 None] Created volume successfully.
Sep 09 04:00:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] Creating offline snapshot 9dd81dc7-76ec-432d-b9cc-b946108b66f7 of volume 747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:00:31 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abca62c-fe7a-48ba-aef5-33cbc5631a41]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:31 devstack sudo[98416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0
Sep 09 04:00:31 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:32 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0" returned: 0 in 0.549s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:32 devstack sudo[98421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7 1G
Sep 09 04:00:32 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:32 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7 1G" returned: 0 in 0.539s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:32 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7
Sep 09 04:00:32 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:32 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7" returned: 0 in 0.317s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:32 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7 is being set with open permissions: ugo+rw
Sep 09 04:00:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:32 devstack sudo[98433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7
Sep 09 04:00:32 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:33 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7" returned: 0 in 0.294s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:33 devstack sudo[98436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.info
Sep 09 04:00:33 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:33 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.info" returned: 0 in 0.303s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:33 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.info is being set with open permissions: ugo+rw
Sep 09 04:00:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:33 devstack sudo[98439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.info
Sep 09 04:00:33 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:33 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.info" returned: 0 in 0.266s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.393s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:33 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2c9fb02d-19c8-47e3-b8eb-a724239d338c tempest-VolumesSnapshotTestJSON-1921432256 None] Create snapshot completed successfully
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Flow 'volume_create_manager' (b4793a34-0e47-4b84-bef1-dc653cc120db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecc760d-348e-41d5-ae50-a7042dec799f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecc760d-348e-41d5-ae50-a7042dec799f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-608434682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbbcc1a0-1097-4921-b4b3-91cd7020e762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea88e3c505a41189845751180d91742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9dd81dc7-76ec-432d-b9cc-b946108b66f7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:35Z,use_quota=True,user_id='13bf5808a2f64512ad3498d234b2366c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9983bb6c-ccdd-4780-9a85-9b58fa248c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9983bb6c-ccdd-4780-9a85-9b58fa248c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c282f4e0-0f25-470e-9b06-784202ab5020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c282f4e0-0f25-470e-9b06-784202ab5020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fbbcc1a0-1097-4921-b4b3-91cd7020e762', 'volume_name': 'volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762', 'volume_size': 2, 'snapshot_id': '9dd81dc7-76ec-432d-b9cc-b946108b66f7'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544badf9-a863-4e06-ac06-8f07f54a738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544badf9-a863-4e06-ac06-8f07f54a738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1b8f7b-7543-4af7-883e-63b6489c935c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:35 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Volume fbbcc1a0-1097-4921-b4b3-91cd7020e762: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762', 'volume_size': 2, 'snapshot_id': '9dd81dc7-76ec-432d-b9cc-b946108b66f7'}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-9dd81dc7-76ec-432d-b9cc-b946108b66f7-fbbcc1a0-1097-4921-b4b3-91cd7020e762" by "_create_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-9dd81dc7-76ec-432d-b9cc-b946108b66f7-fbbcc1a0-1097-4921-b4b3-91cd7020e762" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Creating volume fbbcc1a0-1097-4921-b4b3-91cd7020e762 from snapshot 9dd81dc7-76ec-432d-b9cc-b946108b66f7 {{(pid=87558) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-fbbcc1a0-1097-4921-b4b3-91cd7020e762" by "_copy_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-fbbcc1a0-1097-4921-b4b3-91cd7020e762" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] snapshot: 9dd81dc7-76ec-432d-b9cc-b946108b66f7, volume: fbbcc1a0-1097-4921-b4b3-91cd7020e762,  {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efc44a5-77c4-46fc-8c09-3b83e32ccbab]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:35 devstack sudo[98446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7
Sep 09 04:00:35 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:36 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7" returned: 0 in 0.811s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:00:36 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[06626aff-71ea-4a1a-8fff-b07f2f118d5e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:36 devstack sudo[98506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0
Sep 09 04:00:36 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:36 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0" returned: 0 in 0.629s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 04:00:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Creating direct copy from snapshot {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 04:00:36 devstack cinder-volume[87558]: DEBUG cinder.utils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Path /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762 not found in is_blk_device check {{(pid=87558) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 04:00:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:37 devstack sudo[98527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762
Sep 09 04:00:37 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:43 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762" returned: 0 in 6.863s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:43 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762 {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 04:00:43 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Converted 1024.00 MB image at 149.16 MB/s
Sep 09 04:00:43 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762 is being set with open permissions: ugo+rw
Sep 09 04:00:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:43 devstack sudo[98579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762
Sep 09 04:00:43 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:44 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762" returned: 0 in 0.262s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-fbbcc1a0-1097-4921-b4b3-91cd7020e762" released by "_copy_volume_from_snapshot" :: held 8.696s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-9dd81dc7-76ec-432d-b9cc-b946108b66f7-fbbcc1a0-1097-4921-b4b3-91cd7020e762" released by "_create_volume_from_snapshot" :: held 8.788s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.807s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1b8f7b-7543-4af7-883e-63b6489c935c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762', 'volume_size': 2, 'snapshot_id': '9dd81dc7-76ec-432d-b9cc-b946108b66f7'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37e42d5-92dc-4f08-a50e-8d026fd49f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:44 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Volume volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762 (fbbcc1a0-1097-4921-b4b3-91cd7020e762): created successfully
Sep 09 04:00:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37e42d5-92dc-4f08-a50e-8d026fd49f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Flow 'volume_create_manager' (b4793a34-0e47-4b84-bef1-dc653cc120db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:44 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8d3384d0-3614-494a-b569-0e02923e1349 tempest-VolumesSnapshotTestJSON-1921432256 None] Created volume successfully.
Sep 09 04:00:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-fbbcc1a0-1097-4921-b4b3-91cd7020e762-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-fbbcc1a0-1097-4921-b4b3-91cd7020e762-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-fbbcc1a0-1097-4921-b4b3-91cd7020e762" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-fbbcc1a0-1097-4921-b4b3-91cd7020e762" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:45 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e268b63-9d92-438a-a1d5-e3136e46bbdf]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:45 devstack sudo[98586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762
Sep 09 04:00:45 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:45 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762" returned: 0 in 0.533s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:45 devstack sudo[98604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762
Sep 09 04:00:45 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:46 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fbbcc1a0-1097-4921-b4b3-91cd7020e762" returned: 0 in 0.458s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-fbbcc1a0-1097-4921-b4b3-91cd7020e762" released by "delete_volume" :: held 1.064s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:46 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Created reservations ['3fa3ebb0-cda9-4ff5-ad73-e69df2c6f726', '1f43bb8a-2f3f-4de9-98e9-6a5148466b12', 'a821719c-df76-43ac-a9c8-1a3c50ce967a', '790b4a79-af21-45df-b7ba-8a0dcfd38e1f'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:46 devstack sudo[98657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:00:46 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:46 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.423s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:46 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:00:46 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Deleted volume successfully.
Sep 09 04:00:46 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=145,cinder:SELECT=121,cinder:INSERT=50,cinder:DELETE=18 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:00:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ce9da25b-8cbc-42a8-9cc8-e3b9fc183a28 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-fbbcc1a0-1097-4921-b4b3-91cd7020e762-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-9dd81dc7-76ec-432d-b9cc-b946108b66f7-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-9dd81dc7-76ec-432d-b9cc-b946108b66f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-9dd81dc7-76ec-432d-b9cc-b946108b66f7" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-9dd81dc7-76ec-432d-b9cc-b946108b66f7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Deleting offline snapshot 9dd81dc7-76ec-432d-b9cc-b946108b66f7 of volume 747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:00:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] snapshot_file for this snap is: volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:00:47 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce73f2c-9377-4bb4-b83a-c5add6db68ce]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:47 devstack sudo[98665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7
Sep 09 04:00:47 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:48 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7" returned: 0 in 0.570s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:00:48 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[2323dc9d-86ef-4594-887c-ce4c86d7388c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:48 devstack sudo[98670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0
Sep 09 04:00:48 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:48 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0" returned: 0 in 0.685s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:48 devstack sudo[98675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7
Sep 09 04:00:48 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:49 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7" returned: 0 in 0.573s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:49 devstack sudo[98682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7
Sep 09 04:00:49 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:49 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0.9dd81dc7-76ec-432d-b9cc-b946108b66f7" returned: 0 in 0.383s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:49 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:DELETE=8,cinder:UPDATE=146,cinder:SELECT=115,cinder:INSERT=33 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:00:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-9dd81dc7-76ec-432d-b9cc-b946108b66f7" released by "_delete_snapshot" :: held 2.424s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0" released by "delete_snapshot" :: held 2.474s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:49 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Created reservations ['2813795d-b02b-4305-94df-72bdc876e6fb', '895c0e1f-2ae9-488d-b56f-5a17768dfc15', '38b08c30-eafd-489e-9076-5d6df77b7885', '39bd2f73-e407-4c1a-b11c-6fffdb5cc754'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:50 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Delete snapshot completed successfully.
Sep 09 04:00:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-025ddf34-84a5-4d5d-9704-11b50786523d tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-9dd81dc7-76ec-432d-b9cc-b946108b66f7-delete_snapshot" released by "delete_snapshot" :: held 2.696s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:50 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded0ccf3-d392-4d03-90f8-95aa411b08d2]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:50 devstack sudo[98687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0
Sep 09 04:00:50 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:51 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0" returned: 0 in 0.415s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:51 devstack sudo[98692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0
Sep 09 04:00:51 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:51 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0" returned: 0 in 0.256s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0" released by "delete_volume" :: held 0.735s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:51 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Created reservations ['34779300-4d2a-4365-9792-4975270bc793', 'ccd865a6-b231-4410-b146-74b385202f1d', 'b6985a7b-4f57-4e0d-bf21-f41f0a0bdbfc', 'a2514aec-b851-4284-96d8-5254bd93d997'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:51 devstack sudo[98695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:00:51 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:52 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.298s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:00:52 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Deleted volume successfully.
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7a0fd7ed-79aa-461e-9e4c-340e346525c2 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-747b9e09-5b97-49e8-a8d4-ce9821b9c8f0-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Flow 'volume_create_manager' (761f2891-c0ad-4022-b9d8-4ba4c00f0227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01962076-e221-4065-9e7b-7e97b42d95c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01962076-e221-4065-9e7b-7e97b42d95c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-91905716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616292eb-9539-4237-92b9-e0ebc0684fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea88e3c505a41189845751180d91742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:52Z,use_quota=True,user_id='13bf5808a2f64512ad3498d234b2366c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe4e9e1-c77b-4775-9f53-ecf63f92ac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe4e9e1-c77b-4775-9f53-ecf63f92ac20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c8b0db-af78-451c-b4be-67a306b7a87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c8b0db-af78-451c-b4be-67a306b7a87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '616292eb-9539-4237-92b9-e0ebc0684fb5', 'volume_name': 'volume-616292eb-9539-4237-92b9-e0ebc0684fb5', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cadfe0-1d64-401b-a494-ba3e8635198e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cadfe0-1d64-401b-a494-ba3e8635198e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b25b1a-c4aa-449c-8f9b-ed606e66dded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:52 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Volume 616292eb-9539-4237-92b9-e0ebc0684fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-616292eb-9539-4237-92b9-e0ebc0684fb5', 'volume_size': 1}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-91905716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616292eb-9539-4237-92b9-e0ebc0684fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea88e3c505a41189845751180d91742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:52Z,use_quota=True,user_id='13bf5808a2f64512ad3498d234b2366c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Creating volume 616292eb-9539-4237-92b9-e0ebc0684fb5 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:00:52 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:00:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:52 devstack sudo[98700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5 1073741824
Sep 09 04:00:52 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:53 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5 1073741824" returned: 0 in 0.604s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:53 devstack sudo[98715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5
Sep 09 04:00:53 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:53 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5" returned: 0 in 0.277s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:00:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b25b1a-c4aa-449c-8f9b-ed606e66dded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-616292eb-9539-4237-92b9-e0ebc0684fb5', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff5a6fd-0630-4b5e-a353-97255eb12572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:53 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Volume volume-616292eb-9539-4237-92b9-e0ebc0684fb5 (616292eb-9539-4237-92b9-e0ebc0684fb5): created successfully
Sep 09 04:00:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff5a6fd-0630-4b5e-a353-97255eb12572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Flow 'volume_create_manager' (761f2891-c0ad-4022-b9d8-4ba4c00f0227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:53 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-027c96f3-ebac-4202-8a0a-c450bad7a7ca tempest-VolumesSnapshotTestJSON-1921432256 None] Created volume successfully.
Sep 09 04:00:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Acquiring lock "cinder-8fc2465f-79bd-4b4b-b9a5-255df1593745-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Lock "cinder-8fc2465f-79bd-4b4b-b9a5-255df1593745-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Acquiring lock "cinder-quobyte-8fc2465f-79bd-4b4b-b9a5-255df1593745" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Lock "cinder-quobyte-8fc2465f-79bd-4b4b-b9a5-255df1593745" acquired by "delete_volume" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:54 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fdad29-6d60-4c6b-b9ac-962ccf544cd8]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8fc2465f-79bd-4b4b-b9a5-255df1593745 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] Creating offline snapshot 41af8bee-4bb7-4164-b9bb-13cb9520ba31 of volume 616292eb-9539-4237-92b9-e0ebc0684fb5 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:00:54 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0290c52-8f4b-41fe-9f21-431c4d96d387]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:54 devstack sudo[98718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8fc2465f-79bd-4b4b-b9a5-255df1593745
Sep 09 04:00:54 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:55 devstack sudo[98719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5
Sep 09 04:00:55 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:55 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8fc2465f-79bd-4b4b-b9a5-255df1593745" returned: 0 in 0.384s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8fc2465f-79bd-4b4b-b9a5-255df1593745 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:55 devstack sudo[98728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8fc2465f-79bd-4b4b-b9a5-255df1593745
Sep 09 04:00:55 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:55 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5" returned: 0 in 0.398s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:55 devstack sudo[98731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31 1G
Sep 09 04:00:55 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:55 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8fc2465f-79bd-4b4b-b9a5-255df1593745" returned: 0 in 0.266s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Lock "cinder-quobyte-8fc2465f-79bd-4b4b-b9a5-255df1593745" released by "delete_volume" :: held 0.705s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Created reservations ['5eb40aeb-db0d-469c-906b-d2f8b81dc141', '35582214-601b-42f0-8374-7abbcd45b0ec', '8bd39b16-bf9d-49b4-8de4-e91453f2ab3d', '678b55d9-643c-4ec0-841b-c7bf38207cef'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:55 devstack sudo[98737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:00:55 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:55 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31 1G" returned: 0 in 0.467s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-616292eb-9539-4237-92b9-e0ebc0684fb5 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:55 devstack sudo[98740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-616292eb-9539-4237-92b9-e0ebc0684fb5 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31
Sep 09 04:00:55 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:55 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.283s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:00:55 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Deleted volume successfully.
Sep 09 04:00:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d2b96f6b-b9a2-4a37-895e-3a1a0742243e tempest-VolumesNegativeTest-1421476637 None] Lock "cinder-8fc2465f-79bd-4b4b-b9a5-255df1593745-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:00:56 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-616292eb-9539-4237-92b9-e0ebc0684fb5 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31" returned: 0 in 0.352s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:56 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31 is being set with open permissions: ugo+rw
Sep 09 04:00:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:56 devstack sudo[98747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31
Sep 09 04:00:56 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:56 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31" returned: 0 in 0.274s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:56 devstack sudo[98750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.info
Sep 09 04:00:56 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:56 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.info" returned: 0 in 0.275s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:56 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.info is being set with open permissions: ugo+rw
Sep 09 04:00:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:56 devstack sudo[98753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.info
Sep 09 04:00:56 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:56 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.info" returned: 0 in 0.262s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.144s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:57 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-5d27d56d-af42-4e15-a02c-e68975635877 tempest-VolumesSnapshotTestJSON-1921432256 None] Create snapshot completed successfully
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Flow 'volume_create_manager' (f23a6b35-ae07-4075-9fbd-213787b5e327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37448de7-30d8-43cf-87a8-dbd2852f1471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37448de7-30d8-43cf-87a8-dbd2852f1471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-623103560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91153ded-e1bd-4f2f-9370-07463669e25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea88e3c505a41189845751180d91742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41af8bee-4bb7-4164-b9bb-13cb9520ba31,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:59Z,use_quota=True,user_id='13bf5808a2f64512ad3498d234b2366c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc11565f-f15e-4539-8e69-06cf5c9eff86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc11565f-f15e-4539-8e69-06cf5c9eff86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdded3ae-516a-42ee-8530-355f2fbaad83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdded3ae-516a-42ee-8530-355f2fbaad83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '91153ded-e1bd-4f2f-9370-07463669e25e', 'volume_name': 'volume-91153ded-e1bd-4f2f-9370-07463669e25e', 'volume_size': 1, 'snapshot_id': '41af8bee-4bb7-4164-b9bb-13cb9520ba31'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc272491-0623-4d3e-9f5b-f37a7758d58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc272491-0623-4d3e-9f5b-f37a7758d58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92b5555-3aa2-4b48-b8b2-d7e1355f9f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:00:58 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Volume 91153ded-e1bd-4f2f-9370-07463669e25e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-91153ded-e1bd-4f2f-9370-07463669e25e', 'volume_size': 1, 'snapshot_id': '41af8bee-4bb7-4164-b9bb-13cb9520ba31'}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-41af8bee-4bb7-4164-b9bb-13cb9520ba31-91153ded-e1bd-4f2f-9370-07463669e25e" by "_create_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-41af8bee-4bb7-4164-b9bb-13cb9520ba31-91153ded-e1bd-4f2f-9370-07463669e25e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Creating volume 91153ded-e1bd-4f2f-9370-07463669e25e from snapshot 41af8bee-4bb7-4164-b9bb-13cb9520ba31 {{(pid=87558) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-91153ded-e1bd-4f2f-9370-07463669e25e" by "_copy_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-91153ded-e1bd-4f2f-9370-07463669e25e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] snapshot: 41af8bee-4bb7-4164-b9bb-13cb9520ba31, volume: 91153ded-e1bd-4f2f-9370-07463669e25e,  {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[be41f38e-8d0f-47ee-b710-e212b8b87f8d]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:59 devstack sudo[98756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31
Sep 09 04:00:59 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:59 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31" returned: 0 in 0.403s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-616292eb-9539-4237-92b9-e0ebc0684fb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:00:59 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7f3faa-5824-4ac4-964a-6434e3117b08]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:00:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:59 devstack sudo[98761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5
Sep 09 04:00:59 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:00:59 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root
Sep 09 04:00:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5" returned: 0 in 0.569s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:00:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5 {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 04:00:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Creating direct copy from snapshot {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 04:00:59 devstack cinder-volume[87558]: DEBUG cinder.utils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Path /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e not found in is_blk_device check {{(pid=87558) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 04:00:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:00:59 devstack sudo[98780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e
Sep 09 04:00:59 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:04 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e" returned: 0 in 4.810s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:04 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5, size 1024.00 MB, duration 4.81 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 04:01:04 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Converted 1024.00 MB image at 212.81 MB/s
Sep 09 04:01:04 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e is being set with open permissions: ugo+rw
Sep 09 04:01:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:04 devstack sudo[98793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e
Sep 09 04:01:04 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:05 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e" returned: 0 in 0.247s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-91153ded-e1bd-4f2f-9370-07463669e25e" released by "_copy_volume_from_snapshot" :: held 6.113s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-41af8bee-4bb7-4164-b9bb-13cb9520ba31-91153ded-e1bd-4f2f-9370-07463669e25e" released by "_create_volume_from_snapshot" :: held 6.181s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.199s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92b5555-3aa2-4b48-b8b2-d7e1355f9f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91153ded-e1bd-4f2f-9370-07463669e25e', 'volume_size': 1, 'snapshot_id': '41af8bee-4bb7-4164-b9bb-13cb9520ba31'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1630c340-4dba-4aa5-be01-0f00f7143c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:05 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Volume volume-91153ded-e1bd-4f2f-9370-07463669e25e (91153ded-e1bd-4f2f-9370-07463669e25e): created successfully
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1630c340-4dba-4aa5-be01-0f00f7143c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Flow 'volume_create_manager' (f23a6b35-ae07-4075-9fbd-213787b5e327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:01:05 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3053d667-492b-4ed5-a7de-68a6d598b0bc tempest-VolumesSnapshotTestJSON-1921432256 None] Created volume successfully.
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-91153ded-e1bd-4f2f-9370-07463669e25e-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-91153ded-e1bd-4f2f-9370-07463669e25e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-91153ded-e1bd-4f2f-9370-07463669e25e" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-91153ded-e1bd-4f2f-9370-07463669e25e" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ab485c-a0c4-45d4-93d8-1d8982a59142]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:01:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:05 devstack sudo[98831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e
Sep 09 04:01:05 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:06 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e" returned: 0 in 0.501s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:06 devstack sudo[98839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e
Sep 09 04:01:06 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:06 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-91153ded-e1bd-4f2f-9370-07463669e25e" returned: 0 in 0.261s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-91153ded-e1bd-4f2f-9370-07463669e25e" released by "delete_volume" :: held 0.808s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Created reservations ['7ad56dd0-ef3c-44e2-b338-88c65df22d86', '06b1fe98-53a1-4af2-8bc0-f3db22cb8595', '5b5a8f9a-e088-4a53-81fa-b459517f782e', '1ef3365a-f507-47c9-941e-5294213f30a5'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:06 devstack sudo[98842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:01:06 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-41af8bee-4bb7-4164-b9bb-13cb9520ba31-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-41af8bee-4bb7-4164-b9bb-13cb9520ba31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:01:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-616292eb-9539-4237-92b9-e0ebc0684fb5" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-616292eb-9539-4237-92b9-e0ebc0684fb5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-41af8bee-4bb7-4164-b9bb-13cb9520ba31" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:01:07 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-41af8bee-4bb7-4164-b9bb-13cb9520ba31" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Deleting offline snapshot 41af8bee-4bb7-4164-b9bb-13cb9520ba31 of volume 616292eb-9539-4237-92b9-e0ebc0684fb5 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] snapshot_file for this snap is: volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.355s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:01:07 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Deleted volume successfully.
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0a3466-bd5e-40b4-9122-4d8dd57889d9]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-30e81386-1ade-4dca-b857-f91a10f861ba tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-91153ded-e1bd-4f2f-9370-07463669e25e-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:01:07 devstack sudo[98845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31
Sep 09 04:01:07 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:07 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31" returned: 0 in 0.412s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-616292eb-9539-4237-92b9-e0ebc0684fb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ce37c9-0282-4cf2-9a40-104d289af619]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:01:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:07 devstack sudo[98850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5
Sep 09 04:01:07 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:08 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5" returned: 0 in 0.617s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:08 devstack sudo[98855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31
Sep 09 04:01:08 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:08 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31" returned: 0 in 0.353s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:08 devstack sudo[98860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31
Sep 09 04:01:08 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:08 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5.41af8bee-4bb7-4164-b9bb-13cb9520ba31" returned: 0 in 0.270s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-41af8bee-4bb7-4164-b9bb-13cb9520ba31" released by "_delete_snapshot" :: held 1.767s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:01:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-616292eb-9539-4237-92b9-e0ebc0684fb5" released by "delete_snapshot" :: held 1.804s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:01:08 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Created reservations ['35b52071-2399-4132-a9b3-5c339b4930d8', '90d0081f-07dd-4eb9-8b03-394feeb6a4e5', '1d804eff-f5ea-4c4a-b4e4-51e9d6ff61b3', '2d3637e6-18a0-4179-a0de-881a588f991f'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:01:08 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Delete snapshot completed successfully.
Sep 09 04:01:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cf448a1d-45a0-4751-bd15-da7b6705b0ea tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-41af8bee-4bb7-4164-b9bb-13cb9520ba31-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:01:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-616292eb-9539-4237-92b9-e0ebc0684fb5-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:01:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-616292eb-9539-4237-92b9-e0ebc0684fb5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:01:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-616292eb-9539-4237-92b9-e0ebc0684fb5" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:01:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-616292eb-9539-4237-92b9-e0ebc0684fb5" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:01:09 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[36def082-e87a-4e39-b07d-5786d851394c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:01:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:09 devstack sudo[98869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5
Sep 09 04:01:09 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:09 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5" returned: 0 in 0.453s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:09 devstack sudo[98874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5
Sep 09 04:01:09 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:10 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-616292eb-9539-4237-92b9-e0ebc0684fb5" returned: 0 in 0.287s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-616292eb-9539-4237-92b9-e0ebc0684fb5" released by "delete_volume" :: held 0.816s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Flow 'volume_create_manager' (0efaf39e-c0e1-47de-8f18-0a0fba7927b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3406f2-b44d-4d3f-9951-a07fad8f9d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3406f2-b44d-4d3f-9951-a07fad8f9d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-475435052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6aa965e-1c97-4788-ad34-93fff1743842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4005849666af44728de4a551164d952c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:01:10Z,use_quota=True,user_id='cde3672f26284c5f93027b6bf9319e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da79c1de-19cb-4168-a187-dd757f48a1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da79c1de-19cb-4168-a187-dd757f48a1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56184ffd-6725-4c2d-929e-65418acfdc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56184ffd-6725-4c2d-929e-65418acfdc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6aa965e-1c97-4788-ad34-93fff1743842', 'volume_name': 'volume-c6aa965e-1c97-4788-ad34-93fff1743842', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c163fe-3976-4670-832e-9cba95884421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c163fe-3976-4670-832e-9cba95884421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80966877-7bde-4557-b8f8-3c408a48c7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:10 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Volume c6aa965e-1c97-4788-ad34-93fff1743842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6aa965e-1c97-4788-ad34-93fff1743842', 'volume_size': 1}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-475435052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6aa965e-1c97-4788-ad34-93fff1743842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4005849666af44728de4a551164d952c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:01:10Z,use_quota=True,user_id='cde3672f26284c5f93027b6bf9319e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Creating volume c6aa965e-1c97-4788-ad34-93fff1743842 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:01:10 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c6aa965e-1c97-4788-ad34-93fff1743842 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:10 devstack sudo[98877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c6aa965e-1c97-4788-ad34-93fff1743842 1073741824
Sep 09 04:01:10 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Created reservations ['2370a688-9a6a-4b66-8e64-fe6aa4828d12', 'e4f25b50-add5-49d2-9c9d-a30c83d6aaec', 'a536ccea-b176-4a60-86b9-67aea37a902c', '2f4b00e0-e4bd-4c35-8a35-4e9ccad78610'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:10 devstack sudo[98880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:01:10 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-d8f9f33b-e30b-4f34-8d02-336686a15da0-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-d8f9f33b-e30b-4f34-8d02-336686a15da0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "cinder-quobyte-d8f9f33b-e30b-4f34-8d02-336686a15da0" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-d8f9f33b-e30b-4f34-8d02-336686a15da0" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[24444bcc-40fe-453c-a6e5-b4e3c6418b1f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:10 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.406s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:01:10 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:10 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Deleted volume successfully.
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c6aa965e-1c97-4788-ad34-93fff1743842 1073741824" returned: 0 in 0.620s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f40ab601-25b5-46b5-8387-d1b4cb5fc6d4 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-616292eb-9539-4237-92b9-e0ebc0684fb5-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:01:10 devstack sudo[98887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0
Sep 09 04:01:10 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c6aa965e-1c97-4788-ad34-93fff1743842 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:10 devstack sudo[98890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c6aa965e-1c97-4788-ad34-93fff1743842
Sep 09 04:01:10 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:11 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0" returned: 0 in 0.431s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:11 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:11 devstack sudo[98896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0
Sep 09 04:01:11 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c6aa965e-1c97-4788-ad34-93fff1743842" returned: 0 in 0.295s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80966877-7bde-4557-b8f8-3c408a48c7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6aa965e-1c97-4788-ad34-93fff1743842', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8c2cab-33be-4c12-b045-1c16414cdda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:11 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Volume volume-c6aa965e-1c97-4788-ad34-93fff1743842 (c6aa965e-1c97-4788-ad34-93fff1743842): created successfully
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8c2cab-33be-4c12-b045-1c16414cdda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Flow 'volume_create_manager' (0efaf39e-c0e1-47de-8f18-0a0fba7927b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:01:11 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d14bd568-350c-43d9-addd-11817e8f8bf7 tempest-AttachVolumeTestJSON-1842060037 None] Created volume successfully.
Sep 09 04:01:11 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d8f9f33b-e30b-4f34-8d02-336686a15da0" returned: 0 in 0.245s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-quobyte-d8f9f33b-e30b-4f34-8d02-336686a15da0" released by "delete_volume" :: held 0.750s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Created reservations ['74df89e4-1b6d-44ee-8389-a299c2886aa5', 'bc42d947-cf90-470b-a1a3-fac112a7d241', '67ab120e-4897-469c-a5e5-c85f06273215', '0f99dbf9-4dbe-4acd-9868-4b37c143a85f'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:11 devstack sudo[98899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:01:11 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:11 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.342s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:01:11 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Deleted volume successfully.
Sep 09 04:01:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8575a078-d1ac-4796-9a0c-eb402bb05224 tempest-VolumesSnapshotTestJSON-1921432256 None] Lock "cinder-d8f9f33b-e30b-4f34-8d02-336686a15da0-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:01:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-f61fe206-7700-481a-95aa-aa0026137855 req-361441ca-52be-466f-a1bb-31e2c687a0e4 tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-f61fe206-7700-481a-95aa-aa0026137855 req-361441ca-52be-466f-a1bb-31e2c687a0e4 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-f61fe206-7700-481a-95aa-aa0026137855 req-361441ca-52be-466f-a1bb-31e2c687a0e4 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-f61fe206-7700-481a-95aa-aa0026137855 req-361441ca-52be-466f-a1bb-31e2c687a0e4 tempest-AttachVolumeTestJSON-1842060037 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-c6aa965e-1c97-4788-ad34-93fff1743842', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73b3a8a9-4a6e-4b26-83e7-95e97100d1fb', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 04:01:13 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-f61fe206-7700-481a-95aa-aa0026137855 req-361441ca-52be-466f-a1bb-31e2c687a0e4 tempest-AttachVolumeTestJSON-1842060037 None] attachment_update completed successfully.
Sep 09 04:01:23 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=58,cinder:INSERT=17,cinder:UPDATE=56,cinder:DELETE=4 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:01:23 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=49,cinder:INSERT=15,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:01:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:01:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:01:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:01:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:27 devstack sudo[99817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:01:27 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:27 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.455s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:01:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:01:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 04:01:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Flow 'volume_create_manager' (2179d9df-240e-4c67-b90a-727403c726dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7faccb-4daa-4ebf-a85a-4422c15a394d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7faccb-4daa-4ebf-a85a-4422c15a394d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2039594657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb62add5-5370-48ec-9ddc-4c41f9dbc7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86b11cb5cb444b3b2359587b9725514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:01:31Z,use_quota=True,user_id='fc6c226f397e433a970c6200cc95ac5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6c94e07-6240-499e-9271-f24d207f15f3),volume_type_id=f6c94e07-6240-499e-9271-f24d207f15f3)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1f6f74-483a-404c-9471-73301e200da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1f6f74-483a-404c-9471-73301e200da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896b0055-da67-4f19-b7f5-17d3cfb30043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896b0055-da67-4f19-b7f5-17d3cfb30043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb62add5-5370-48ec-9ddc-4c41f9dbc7d0', 'volume_name': 'volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ae3e31-ec3e-41a6-9ef5-fe6776df2c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ae3e31-ec3e-41a6-9ef5-fe6776df2c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640e1347-510b-4136-90dd-7d9126f0b098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:31 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Volume fb62add5-5370-48ec-9ddc-4c41f9dbc7d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0', 'volume_size': 1}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2039594657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb62add5-5370-48ec-9ddc-4c41f9dbc7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86b11cb5cb444b3b2359587b9725514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:01:31Z,use_quota=True,user_id='fc6c226f397e433a970c6200cc95ac5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6c94e07-6240-499e-9271-f24d207f15f3),volume_type_id=f6c94e07-6240-499e-9271-f24d207f15f3)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Creating volume fb62add5-5370-48ec-9ddc-4c41f9dbc7d0 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:01:31 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:31 devstack sudo[99820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0 1073741824
Sep 09 04:01:31 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Flow 'volume_create_manager' (87397ab9-3668-4a5c-bd8f-0a7c5e9b93d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00128166-dd01-437f-bb6b-065fb61384a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00128166-dd01-437f-bb6b-065fb61384a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-584130685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7774aa96-523a-4a14-a6b8-a973de405029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86b11cb5cb444b3b2359587b9725514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:01:32Z,use_quota=True,user_id='fc6c226f397e433a970c6200cc95ac5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab57e96b-20c4-44ed-99cc-fff0c8203618),volume_type_id=ab57e96b-20c4-44ed-99cc-fff0c8203618)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f7a412-85a0-493f-9a1a-ccf6cdfd69d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f7a412-85a0-493f-9a1a-ccf6cdfd69d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2dde98b-2431-4ba7-a5fa-df1b8356e6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2dde98b-2431-4ba7-a5fa-df1b8356e6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7774aa96-523a-4a14-a6b8-a973de405029', 'volume_name': 'volume-7774aa96-523a-4a14-a6b8-a973de405029', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987e19ba-5e3c-4e0c-9f74-248d9cf6ab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987e19ba-5e3c-4e0c-9f74-248d9cf6ab3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cc65b4-14d2-4624-9efa-3866b0f62dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:31 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Volume 7774aa96-523a-4a14-a6b8-a973de405029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7774aa96-523a-4a14-a6b8-a973de405029', 'volume_size': 1}
Sep 09 04:01:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:32 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0 1073741824" returned: 0 in 0.789s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:32 devstack sudo[99825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0
Sep 09 04:01:32 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:32 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0" returned: 0 in 0.320s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-584130685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7774aa96-523a-4a14-a6b8-a973de405029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86b11cb5cb444b3b2359587b9725514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:01:32Z,use_quota=True,user_id='fc6c226f397e433a970c6200cc95ac5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab57e96b-20c4-44ed-99cc-fff0c8203618),volume_type_id=ab57e96b-20c4-44ed-99cc-fff0c8203618)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Creating volume 7774aa96-523a-4a14-a6b8-a973de405029 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:01:32 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7774aa96-523a-4a14-a6b8-a973de405029 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640e1347-510b-4136-90dd-7d9126f0b098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7c7bab-8721-479f-b2b9-f5c1607ceaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:32 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Volume volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0 (fb62add5-5370-48ec-9ddc-4c41f9dbc7d0): created successfully
Sep 09 04:01:32 devstack sudo[99829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7774aa96-523a-4a14-a6b8-a973de405029 1073741824
Sep 09 04:01:32 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7c7bab-8721-479f-b2b9-f5c1607ceaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Flow 'volume_create_manager' (2179d9df-240e-4c67-b90a-727403c726dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:01:32 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6a3b0c80-352f-46fb-852c-5926bd2d772c tempest-TestInstancesWithCinderVolumes-1860854434 None] Created volume successfully.
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Flow 'volume_create_manager' (b2b05397-d524-41e5-8378-180ef6bcf64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71808f88-eb43-43a2-ab9b-96c8146a8a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71808f88-eb43-43a2-ab9b-96c8146a8a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-108856303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74ba453-c2cd-4e47-bbfa-f9811bc4d40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86b11cb5cb444b3b2359587b9725514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:01:33Z,use_quota=True,user_id='fc6c226f397e433a970c6200cc95ac5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61692282-a58c-4722-8f5e-0810851a1f3f),volume_type_id=61692282-a58c-4722-8f5e-0810851a1f3f)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575fc8b7-e8da-47f7-8781-0082526ab509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575fc8b7-e8da-47f7-8781-0082526ab509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e239048-b6b3-4845-a0c6-b406c8868de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG cinder.image.glance [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Creating Keystone auth plugin from conf {{(pid=87558) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 04:01:33 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7774aa96-523a-4a14-a6b8-a973de405029 1073741824" returned: 0 in 0.770s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7774aa96-523a-4a14-a6b8-a973de405029 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:33 devstack sudo[99835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7774aa96-523a-4a14-a6b8-a973de405029
Sep 09 04:01:33 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e239048-b6b3-4845-a0c6-b406c8868de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd74ba453-c2cd-4e47-bbfa-f9811bc4d40a', 'volume_name': 'volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a', 'volume_size': 1, 'image_id': '7ab01c60-407e-4f2e-8b8b-04aa3c56365c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ab01c60-407e-4f2e-8b8b-04aa3c56365c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--731488646', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a86b11cb5cb444b3b2359587b9725514', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ab01c60-407e-4f2e-8b8b-04aa3c56365c', 'created_at': datetime.datetime(2026, 9, 9, 2, 1, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 2, 1, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ab01c60-407e-4f2e-8b8b-04aa3c56365c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01dc290>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3c8ed5-7ea9-40b1-8d06-1f20b5e3bb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3c8ed5-7ea9-40b1-8d06-1f20b5e3bb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1030519b-341f-4b54-8aae-a8fafd38ced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:33 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Volume d74ba453-c2cd-4e47-bbfa-f9811bc4d40a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a', 'volume_size': 1, 'image_id': '7ab01c60-407e-4f2e-8b8b-04aa3c56365c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ab01c60-407e-4f2e-8b8b-04aa3c56365c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--731488646', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a86b11cb5cb444b3b2359587b9725514', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ab01c60-407e-4f2e-8b8b-04aa3c56365c', 'created_at': datetime.datetime(2026, 9, 9, 2, 1, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 2, 1, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ab01c60-407e-4f2e-8b8b-04aa3c56365c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01dc290>}
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Trying to clone d74ba453-c2cd-4e47-bbfa-f9811bc4d40a from image 7ab01c60-407e-4f2e-8b8b-04aa3c56365c at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ab01c60-407e-4f2e-8b8b-04aa3c56365c', 'metadata': {}}]). {{(pid=87558) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 04:01:33 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7774aa96-523a-4a14-a6b8-a973de405029" returned: 0 in 0.582s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cc65b4-14d2-4624-9efa-3866b0f62dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7774aa96-523a-4a14-a6b8-a973de405029', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a4fca2-a7af-440f-8592-b5647769868d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:33 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Volume volume-7774aa96-523a-4a14-a6b8-a973de405029 (7774aa96-523a-4a14-a6b8-a973de405029): created successfully
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a4fca2-a7af-440f-8592-b5647769868d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Flow 'volume_create_manager' (87397ab9-3668-4a5c-bd8f-0a7c5e9b93d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:01:33 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c0125cb0-6fdf-408e-99c4-60035ed37e08 tempest-TestInstancesWithCinderVolumes-1860854434 None] Created volume successfully.
Sep 09 04:01:37 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD, size 20.69 MB, duration 4.23 sec {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 04:01:37 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Image download 20.69 MB at 4.89 MB/s
Sep 09 04:01:37 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaad3a0-bff5-49f9-a811-69b31b5daf44]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:01:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:37 devstack sudo[99850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD
Sep 09 04:01:37 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:38 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Temporary image 7ab01c60-407e-4f2e-8b8b-04aa3c56365c is fetched for user fc6c226f397e433a970c6200cc95ac5d. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5888347-b436-43ec-aa25-5bc57525e1a0]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:38 devstack sudo[99855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD
Sep 09 04:01:38 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:38 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-108856303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74ba453-c2cd-4e47-bbfa-f9811bc4d40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86b11cb5cb444b3b2359587b9725514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:01:33Z,use_quota=True,user_id='fc6c226f397e433a970c6200cc95ac5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61692282-a58c-4722-8f5e-0810851a1f3f),volume_type_id=61692282-a58c-4722-8f5e-0810851a1f3f)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Creating volume d74ba453-c2cd-4e47-bbfa-f9811bc4d40a {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:01:38 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:01:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:38 devstack sudo[99860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a 1073741824
Sep 09 04:01:38 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:39 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a 1073741824" returned: 0 in 0.474s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:39 devstack sudo[99866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a
Sep 09 04:01:39 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:39 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a" returned: 0 in 0.276s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:01:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:39 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Attempting download of 7ab01c60-407e-4f2e-8b8b-04aa3c56365c ((None, [{'url': 'file:///opt/stack/data/glance/images/7ab01c60-407e-4f2e-8b8b-04aa3c56365c', 'metadata': {}}])) to volume d74ba453-c2cd-4e47-bbfa-f9811bc4d40a. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 04:01:39 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e9040b-77fa-44a9-974c-fd70d3b0fd55]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:01:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_v_bj9t3g {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:39 devstack sudo[99869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_v_bj9t3g
Sep 09 04:01:39 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:39 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_v_bj9t3g" returned: 0 in 0.400s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_v_bj9t3g {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:39 devstack sudo[99873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_v_bj9t3g
Sep 09 04:01:39 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:40 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_v_bj9t3g" returned: 1 in 0.361s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_v_bj9t3g' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:01:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5531cc7-fb2c-479c-a5a5-ed1911d5b1d0]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:01:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:40 devstack sudo[99901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD
Sep 09 04:01:40 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:40 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:40 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] 7ab01c60-407e-4f2e-8b8b-04aa3c56365c was qcow2, converting to qcow2 {{(pid=87558) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 04:01:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:40 devstack sudo[99906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a
Sep 09 04:01:40 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:42 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a" returned: 0 in 2.064s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:42 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ab01c60-407e-4f2e-8b8b-04aa3c56365c_i1ofbi6gdevstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 04:01:42 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Converted 112.00 MB image at 54.23 MB/s
Sep 09 04:01:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:42 devstack sudo[99916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a 1G
Sep 09 04:01:42 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:43 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a 1G" returned: 0 in 0.371s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:43 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Downloaded image 7ab01c60-407e-4f2e-8b8b-04aa3c56365c ((None, [{'url': 'file:///opt/stack/data/glance/images/7ab01c60-407e-4f2e-8b8b-04aa3c56365c', 'metadata': {}}])) to volume d74ba453-c2cd-4e47-bbfa-f9811bc4d40a successfully. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 04:01:43 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Temporary image 7ab01c60-407e-4f2e-8b8b-04aa3c56365c for user fc6c226f397e433a970c6200cc95ac5d is deleted. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 04:01:43 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Marking volume d74ba453-c2cd-4e47-bbfa-f9811bc4d40a as bootable. {{(pid=87558) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 04:01:43 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Copying metadata from image 7ab01c60-407e-4f2e-8b8b-04aa3c56365c to d74ba453-c2cd-4e47-bbfa-f9811bc4d40a. {{(pid=87558) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 04:01:43 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Creating volume glance metadata for volume d74ba453-c2cd-4e47-bbfa-f9811bc4d40a backed by image 7ab01c60-407e-4f2e-8b8b-04aa3c56365c with: {'image_id': '7ab01c60-407e-4f2e-8b8b-04aa3c56365c', 'image_name': 'tempest-scenario-img--731488646', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87558) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 04:01:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1030519b-341f-4b54-8aae-a8fafd38ced0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a', 'volume_size': 1, 'image_id': '7ab01c60-407e-4f2e-8b8b-04aa3c56365c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ab01c60-407e-4f2e-8b8b-04aa3c56365c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--731488646', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a86b11cb5cb444b3b2359587b9725514', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ab01c60-407e-4f2e-8b8b-04aa3c56365c', 'created_at': datetime.datetime(2026, 9, 9, 2, 1, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 2, 1, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ab01c60-407e-4f2e-8b8b-04aa3c56365c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01dc290>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2891512b-8f80-4845-96d4-91f48dbc42e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:43 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Volume volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a (d74ba453-c2cd-4e47-bbfa-f9811bc4d40a): created successfully
Sep 09 04:01:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2891512b-8f80-4845-96d4-91f48dbc42e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Flow 'volume_create_manager' (b2b05397-d524-41e5-8378-180ef6bcf64b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:01:43 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-be1a1086-35e2-4259-a2ac-609c6ec37c45 tempest-TestInstancesWithCinderVolumes-1860854434 None] Created volume successfully.
Sep 09 04:01:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-f8ed0f0a-698e-43df-a5d5-6216a9a61b89 req-4ddb295e-e9e5-4b17-a0c0-b30e1827ffd2 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-f8ed0f0a-698e-43df-a5d5-6216a9a61b89 req-4ddb295e-e9e5-4b17-a0c0-b30e1827ffd2 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-f8ed0f0a-698e-43df-a5d5-6216a9a61b89 req-4ddb295e-e9e5-4b17-a0c0-b30e1827ffd2 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-f8ed0f0a-698e-43df-a5d5-6216a9a61b89 req-4ddb295e-e9e5-4b17-a0c0-b30e1827ffd2 tempest-TestInstancesWithCinderVolumes-1860854434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0004b933-c66a-4b06-bb4e-015aa7f38a21', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 04:01:46 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-f8ed0f0a-698e-43df-a5d5-6216a9a61b89 req-4ddb295e-e9e5-4b17-a0c0-b30e1827ffd2 tempest-TestInstancesWithCinderVolumes-1860854434 None] attachment_update completed successfully.
Sep 09 04:01:47 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-d97f967a-cb07-45bf-be73-2651efa49d6c req-94f7ccc7-8c64-4ee1-9486-dde8f5922011 tempest-AttachVolumeTestJSON-1842060037 None] Terminate volume connection completed successfully.
Sep 09 04:01:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-d97f967a-cb07-45bf-be73-2651efa49d6c req-94f7ccc7-8c64-4ee1-9486-dde8f5922011 tempest-AttachVolumeTestJSON-1842060037 None] Deleting attachment 73b3a8a9-4a6e-4b26-83e7-95e97100d1fb. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Flow 'volume_create_manager' (fb951334-f53e-4ccd-81b5-2edb4398b645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b997453a-3a88-415c-88ea-df1ea2ea6916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b997453a-3a88-415c-88ea-df1ea2ea6916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1542485376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c831508b-aec2-49bc-91d8-5006d775e4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffbdfa5f88a847d3952e1edee43fc5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:01:49Z,use_quota=True,user_id='dc1025704083437b8215408d5137f1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6865e2c8-3b72-4710-9912-69f5409bc909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6865e2c8-3b72-4710-9912-69f5409bc909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21446af-c35a-42a5-9539-b91206ca4665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21446af-c35a-42a5-9539-b91206ca4665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c831508b-aec2-49bc-91d8-5006d775e4e8', 'volume_name': 'volume-c831508b-aec2-49bc-91d8-5006d775e4e8', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3c7cd2-1d2f-4fb8-9081-d2b8a01c25a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3c7cd2-1d2f-4fb8-9081-d2b8a01c25a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2578e142-f266-44b8-bfda-11f891a467b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:48 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Volume c831508b-aec2-49bc-91d8-5006d775e4e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c831508b-aec2-49bc-91d8-5006d775e4e8', 'volume_size': 1}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1542485376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c831508b-aec2-49bc-91d8-5006d775e4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffbdfa5f88a847d3952e1edee43fc5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:01:49Z,use_quota=True,user_id='dc1025704083437b8215408d5137f1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Creating volume c831508b-aec2-49bc-91d8-5006d775e4e8 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:01:48 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:01:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c831508b-aec2-49bc-91d8-5006d775e4e8 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:48 devstack sudo[99944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c831508b-aec2-49bc-91d8-5006d775e4e8 1073741824
Sep 09 04:01:48 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Flow 'volume_create_manager' (8282e1b8-5b94-4cd3-90fd-8253a10a16aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be781972-232e-4cdf-a3cd-e6c96f0a6fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be781972-232e-4cdf-a3cd-e6c96f0a6fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1530554403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed07b2a-41c6-4646-a67f-1b4208e83599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffbdfa5f88a847d3952e1edee43fc5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:01:49Z,use_quota=True,user_id='dc1025704083437b8215408d5137f1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5660a9d8-3995-47cb-8acb-4e31f232ba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5660a9d8-3995-47cb-8acb-4e31f232ba3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1bcfeab-ad14-4d61-a512-a3d9178be0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1bcfeab-ad14-4d61-a512-a3d9178be0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed07b2a-41c6-4646-a67f-1b4208e83599', 'volume_name': 'volume-eed07b2a-41c6-4646-a67f-1b4208e83599', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5a8f99-ffc5-414b-8e52-55b960f56d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5a8f99-ffc5-414b-8e52-55b960f56d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0f600d-10ae-4160-8cb5-322f493e15b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:49 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Volume eed07b2a-41c6-4646-a67f-1b4208e83599: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed07b2a-41c6-4646-a67f-1b4208e83599', 'volume_size': 1}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:49 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c831508b-aec2-49bc-91d8-5006d775e4e8 1073741824" returned: 0 in 0.605s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c831508b-aec2-49bc-91d8-5006d775e4e8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:49 devstack sudo[99952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c831508b-aec2-49bc-91d8-5006d775e4e8
Sep 09 04:01:49 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:49 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c831508b-aec2-49bc-91d8-5006d775e4e8" returned: 0 in 0.526s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1530554403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed07b2a-41c6-4646-a67f-1b4208e83599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffbdfa5f88a847d3952e1edee43fc5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:01:49Z,use_quota=True,user_id='dc1025704083437b8215408d5137f1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Creating volume eed07b2a-41c6-4646-a67f-1b4208e83599 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:01:49 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-eed07b2a-41c6-4646-a67f-1b4208e83599 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:49 devstack sudo[100021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-eed07b2a-41c6-4646-a67f-1b4208e83599 1073741824
Sep 09 04:01:49 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2578e142-f266-44b8-bfda-11f891a467b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c831508b-aec2-49bc-91d8-5006d775e4e8', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d565953-4888-4d6d-b606-7bbde987423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:50 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Volume volume-c831508b-aec2-49bc-91d8-5006d775e4e8 (c831508b-aec2-49bc-91d8-5006d775e4e8): created successfully
Sep 09 04:01:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d565953-4888-4d6d-b606-7bbde987423d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Flow 'volume_create_manager' (fb951334-f53e-4ccd-81b5-2edb4398b645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:01:50 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d96457c3-a217-4bcb-8b95-ff82d37a2c31 tempest-TestServerVolumeAttachmentScenario-619977674 None] Created volume successfully.
Sep 09 04:01:50 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-eed07b2a-41c6-4646-a67f-1b4208e83599 1073741824" returned: 0 in 0.953s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-eed07b2a-41c6-4646-a67f-1b4208e83599 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:01:51 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-eed07b2a-41c6-4646-a67f-1b4208e83599
Sep 09 04:01:51 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:01:51 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Sep 09 04:01:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-eed07b2a-41c6-4646-a67f-1b4208e83599" returned: 0 in 0.535s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:01:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:01:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:01:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0f600d-10ae-4160-8cb5-322f493e15b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed07b2a-41c6-4646-a67f-1b4208e83599', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf84efa-93ff-41a9-a0f5-b0580c7ddc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:01:51 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Volume volume-eed07b2a-41c6-4646-a67f-1b4208e83599 (eed07b2a-41c6-4646-a67f-1b4208e83599): created successfully
Sep 09 04:01:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf84efa-93ff-41a9-a0f5-b0580c7ddc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:01:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Flow 'volume_create_manager' (8282e1b8-5b94-4cd3-90fd-8253a10a16aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:01:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4aed5aa0-c6a1-4a56-a0dd-e589d1262020 tempest-TestServerVolumeAttachmentScenario-619977674 None] Created volume successfully.
Sep 09 04:02:01 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=22,cinder:SELECT=18,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:02:01 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=28,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:02:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-1b9e99e9-a40e-464c-b284-a382b21c6b9a req-455a5e81-6e99-44d4-aa4e-f1ba1358395a tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:02:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-1b9e99e9-a40e-464c-b284-a382b21c6b9a req-455a5e81-6e99-44d4-aa4e-f1ba1358395a tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:02:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-1b9e99e9-a40e-464c-b284-a382b21c6b9a req-455a5e81-6e99-44d4-aa4e-f1ba1358395a tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:02:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:02:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:02:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:02:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:02:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:02:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:02:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:27 devstack sudo[100729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:02:27 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-1b9e99e9-a40e-464c-b284-a382b21c6b9a req-455a5e81-6e99-44d4-aa4e-f1ba1358395a tempest-TestInstancesWithCinderVolumes-1860854434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c7d4d8f-24b4-4cd6-a75c-47062cafc440', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 04:02:27 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-1b9e99e9-a40e-464c-b284-a382b21c6b9a req-455a5e81-6e99-44d4-aa4e-f1ba1358395a tempest-TestInstancesWithCinderVolumes-1860854434 None] attachment_update completed successfully.
Sep 09 04:02:27 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.291s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:02:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:02:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 04:02:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 04:02:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-3224a0ef-891d-4002-bc81-751b377855c6 req-db6fcbaf-c10c-4fe9-8d14-e904f696399f tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:02:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-3224a0ef-891d-4002-bc81-751b377855c6 req-db6fcbaf-c10c-4fe9-8d14-e904f696399f tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:02:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-3224a0ef-891d-4002-bc81-751b377855c6 req-db6fcbaf-c10c-4fe9-8d14-e904f696399f tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:02:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-3224a0ef-891d-4002-bc81-751b377855c6 req-db6fcbaf-c10c-4fe9-8d14-e904f696399f tempest-TestInstancesWithCinderVolumes-1860854434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-7774aa96-523a-4a14-a6b8-a973de405029', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a1bac51-1818-4552-91e8-52fffb20fe42', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 04:02:29 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-3224a0ef-891d-4002-bc81-751b377855c6 req-db6fcbaf-c10c-4fe9-8d14-e904f696399f tempest-TestInstancesWithCinderVolumes-1860854434 None] attachment_update completed successfully.
Sep 09 04:02:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-9ff96f43-adf9-4ffb-9c0b-47ad12fc2a94 req-5156934a-385f-4732-9228-5cea20886b56 tempest-TestServerVolumeAttachmentScenario-619977674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:02:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-9ff96f43-adf9-4ffb-9c0b-47ad12fc2a94 req-5156934a-385f-4732-9228-5cea20886b56 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:02:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-9ff96f43-adf9-4ffb-9c0b-47ad12fc2a94 req-5156934a-385f-4732-9228-5cea20886b56 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:02:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-9ff96f43-adf9-4ffb-9c0b-47ad12fc2a94 req-5156934a-385f-4732-9228-5cea20886b56 tempest-TestServerVolumeAttachmentScenario-619977674 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-c831508b-aec2-49bc-91d8-5006d775e4e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2533d0e2-3ad7-40e0-941b-fc3e0cca2d06', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 04:02:29 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-9ff96f43-adf9-4ffb-9c0b-47ad12fc2a94 req-5156934a-385f-4732-9228-5cea20886b56 tempest-TestServerVolumeAttachmentScenario-619977674 None] attachment_update completed successfully.
Sep 09 04:02:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-fbf796b0-ae76-4052-87b5-944832f30779 req-274ea28b-f7ca-4c19-89fc-7f07d39373d7 tempest-TestServerVolumeAttachmentScenario-619977674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:02:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-fbf796b0-ae76-4052-87b5-944832f30779 req-274ea28b-f7ca-4c19-89fc-7f07d39373d7 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:02:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-fbf796b0-ae76-4052-87b5-944832f30779 req-274ea28b-f7ca-4c19-89fc-7f07d39373d7 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:02:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-fbf796b0-ae76-4052-87b5-944832f30779 req-274ea28b-f7ca-4c19-89fc-7f07d39373d7 tempest-TestServerVolumeAttachmentScenario-619977674 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-eed07b2a-41c6-4646-a67f-1b4208e83599', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3765d2a1-dcf4-4af0-9f66-35e36b79c1ed', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 04:02:32 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-fbf796b0-ae76-4052-87b5-944832f30779 req-274ea28b-f7ca-4c19-89fc-7f07d39373d7 tempest-TestServerVolumeAttachmentScenario-619977674 None] attachment_update completed successfully.
Sep 09 04:02:33 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-55221d0d-40d4-49ef-923c-478de2d7a958 req-825007ec-99a2-4f80-b1ff-2ccc6beda019 tempest-TestInstancesWithCinderVolumes-1860854434 None] Terminate volume connection completed successfully.
Sep 09 04:02:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-55221d0d-40d4-49ef-923c-478de2d7a958 req-825007ec-99a2-4f80-b1ff-2ccc6beda019 tempest-TestInstancesWithCinderVolumes-1860854434 None] Deleting attachment 2c7d4d8f-24b4-4cd6-a75c-47062cafc440. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 04:02:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "cinder-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:02:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "cinder-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:02:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "cinder-quobyte-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:02:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "cinder-quobyte-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:02:34 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[829e5175-b3b0-4355-9fb5-d81d35147813]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:02:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:34 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-f7ffb207-0d9c-4786-a4ac-c198e8e959d6 req-d1610042-69d7-46a8-a3cc-2e760c7ec838 tempest-TestServerVolumeAttachmentScenario-619977674 None] Terminate volume connection completed successfully.
Sep 09 04:02:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-f7ffb207-0d9c-4786-a4ac-c198e8e959d6 req-d1610042-69d7-46a8-a3cc-2e760c7ec838 tempest-TestServerVolumeAttachmentScenario-619977674 None] Deleting attachment 3765d2a1-dcf4-4af0-9f66-35e36b79c1ed. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 04:02:34 devstack sudo[100844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0
Sep 09 04:02:34 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:35 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0" returned: 0 in 0.519s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:35 devstack sudo[100854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0
Sep 09 04:02:35 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:35 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0" returned: 0 in 0.330s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "cinder-quobyte-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0" released by "delete_volume" :: held 0.907s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:02:35 devstack cinder-volume[87558]: WARNING cinder.quota [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-723536558-1971360777 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-723536558-1971360777, it is now deprecated. Please use the default quota class for default quota.
Sep 09 04:02:35 devstack cinder-volume[87558]: WARNING cinder.quota [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-723536558-1971360777 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-723536558-1971360777, it is now deprecated. Please use the default quota class for default quota.
Sep 09 04:02:35 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Created reservations ['e5a011af-804b-45f2-a0ec-fd08c4ef705d', 'ea3d542f-35c5-4f12-9c92-e6318481927d', 'a549a885-7522-4039-bfb2-6463051a1b10', 'c8d9f54b-200b-436b-93bb-b8c54aa84841'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:02:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:02:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:02:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:02:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:02:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:02:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:35 devstack sudo[100859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:02:35 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:36 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.384s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:36 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:02:36 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Deleted volume successfully.
Sep 09 04:02:36 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-227201d7-b90e-4133-bbb3-86c3b0075f46 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "cinder-fb62add5-5370-48ec-9ddc-4c41f9dbc7d0-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:02:36 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-3058fc14-60f6-4d06-818e-b3a39dc44416 req-ca53f550-45b8-4c93-864f-1a2ea0baffbf tempest-TestServerVolumeAttachmentScenario-619977674 None] Terminate volume connection completed successfully.
Sep 09 04:02:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-3058fc14-60f6-4d06-818e-b3a39dc44416 req-ca53f550-45b8-4c93-864f-1a2ea0baffbf tempest-TestServerVolumeAttachmentScenario-619977674 None] Deleting attachment 2533d0e2-3ad7-40e0-941b-fc3e0cca2d06. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 04:02:39 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-4476537f-36a1-4c21-a290-8a6230d6610d req-3bc4b3c3-a7e9-48d6-af95-fc30bf821513 tempest-TestInstancesWithCinderVolumes-1860854434 None] Terminate volume connection completed successfully.
Sep 09 04:02:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-4476537f-36a1-4c21-a290-8a6230d6610d req-3bc4b3c3-a7e9-48d6-af95-fc30bf821513 tempest-TestInstancesWithCinderVolumes-1860854434 None] Deleting attachment 8a1bac51-1818-4552-91e8-52fffb20fe42. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 04:02:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "cinder-7774aa96-523a-4a14-a6b8-a973de405029-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:02:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "cinder-7774aa96-523a-4a14-a6b8-a973de405029-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:02:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "cinder-quobyte-7774aa96-523a-4a14-a6b8-a973de405029" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:02:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "cinder-quobyte-7774aa96-523a-4a14-a6b8-a973de405029" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:02:39 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[146191b1-199d-4270-94ee-258f7e06daa4]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:02:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7774aa96-523a-4a14-a6b8-a973de405029 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:40 devstack sudo[100909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7774aa96-523a-4a14-a6b8-a973de405029
Sep 09 04:02:40 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:40 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7774aa96-523a-4a14-a6b8-a973de405029" returned: 0 in 0.481s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7774aa96-523a-4a14-a6b8-a973de405029 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:40 devstack sudo[100916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7774aa96-523a-4a14-a6b8-a973de405029
Sep 09 04:02:40 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:40 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7774aa96-523a-4a14-a6b8-a973de405029" returned: 0 in 0.288s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "cinder-quobyte-7774aa96-523a-4a14-a6b8-a973de405029" released by "delete_volume" :: held 0.820s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:02:40 devstack cinder-volume[87558]: WARNING cinder.quota [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1539861405-1772001960 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1539861405-1772001960, it is now deprecated. Please use the default quota class for default quota.
Sep 09 04:02:40 devstack cinder-volume[87558]: WARNING cinder.quota [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1539861405-1772001960 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1539861405-1772001960, it is now deprecated. Please use the default quota class for default quota.
Sep 09 04:02:40 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Created reservations ['0b39db74-82a1-47f0-8218-ec7a47abe6cc', '9c729d93-15d7-4fe4-acf9-93ad61de373d', '84f530a1-7952-4709-8170-2b54a848909a', '407e4fb0-94d3-446e-a5bc-7b78b252e75b'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:02:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:02:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:02:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:02:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:02:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:02:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:40 devstack sudo[100919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:02:40 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:41 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.301s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:41 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:02:41 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Deleted volume successfully.
Sep 09 04:02:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-330ae72b-654f-470c-b936-0d152300c5e0 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "cinder-7774aa96-523a-4a14-a6b8-a973de405029-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:02:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Acquiring lock "cinder-eed07b2a-41c6-4646-a67f-1b4208e83599-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:02:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "cinder-eed07b2a-41c6-4646-a67f-1b4208e83599-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:02:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Acquiring lock "cinder-quobyte-eed07b2a-41c6-4646-a67f-1b4208e83599" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:02:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "cinder-quobyte-eed07b2a-41c6-4646-a67f-1b4208e83599" acquired by "delete_volume" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:02:43 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[59521c81-81b1-4e6b-b369-c6c978900a1e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:02:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-eed07b2a-41c6-4646-a67f-1b4208e83599 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:43 devstack sudo[100929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-eed07b2a-41c6-4646-a67f-1b4208e83599
Sep 09 04:02:43 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:44 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-eed07b2a-41c6-4646-a67f-1b4208e83599" returned: 0 in 0.602s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-eed07b2a-41c6-4646-a67f-1b4208e83599 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:44 devstack sudo[100961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-eed07b2a-41c6-4646-a67f-1b4208e83599
Sep 09 04:02:44 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:44 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-eed07b2a-41c6-4646-a67f-1b4208e83599" returned: 0 in 0.536s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "cinder-quobyte-eed07b2a-41c6-4646-a67f-1b4208e83599" released by "delete_volume" :: held 1.221s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:02:44 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Created reservations ['9ad4455b-f744-4b6c-9489-f1de1f859a7f', 'b730c883-580b-4eb7-a61f-dacf80c0a1bf', 'e05dda16-f594-44eb-8ed0-7847376267ae', '999468f4-4129-4e21-a103-b2ac653db588'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:02:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:02:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:02:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:02:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:02:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:02:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:45 devstack sudo[100974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:02:45 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:45 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.315s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:45 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:02:45 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Deleted volume successfully.
Sep 09 04:02:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d8c6d173-100a-4d55-8dbd-37e84275dca5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "cinder-eed07b2a-41c6-4646-a67f-1b4208e83599-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:02:45 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-53426e62-3ec3-4a95-a4c5-474c83229b23 req-3866cbca-517f-4947-9881-8e62d8967937 tempest-TestInstancesWithCinderVolumes-1860854434 None] Terminate volume connection completed successfully.
Sep 09 04:02:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-53426e62-3ec3-4a95-a4c5-474c83229b23 req-3866cbca-517f-4947-9881-8e62d8967937 tempest-TestInstancesWithCinderVolumes-1860854434 None] Deleting attachment 0004b933-c66a-4b06-bb4e-015aa7f38a21. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Acquiring lock "cinder-c831508b-aec2-49bc-91d8-5006d775e4e8-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "cinder-c831508b-aec2-49bc-91d8-5006d775e4e8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Acquiring lock "cinder-quobyte-c831508b-aec2-49bc-91d8-5006d775e4e8" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "cinder-quobyte-c831508b-aec2-49bc-91d8-5006d775e4e8" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b09851-d744-4ff4-8d73-f5e57796ff68]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c831508b-aec2-49bc-91d8-5006d775e4e8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:46 devstack sudo[100979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c831508b-aec2-49bc-91d8-5006d775e4e8
Sep 09 04:02:46 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:46 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c831508b-aec2-49bc-91d8-5006d775e4e8" returned: 0 in 0.385s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c831508b-aec2-49bc-91d8-5006d775e4e8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:46 devstack sudo[100984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c831508b-aec2-49bc-91d8-5006d775e4e8
Sep 09 04:02:46 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "cinder-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "cinder-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "cinder-quobyte-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "cinder-quobyte-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:02:46 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1534ba-d436-4015-aca2-c1876f9ada46]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c831508b-aec2-49bc-91d8-5006d775e4e8" returned: 0 in 0.320s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "cinder-quobyte-c831508b-aec2-49bc-91d8-5006d775e4e8" released by "delete_volume" :: held 0.752s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:02:46 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Created reservations ['632f4724-59a9-4719-82ea-5ef35b8a3b16', '490652dd-ce51-4f95-a920-060f8b5a3b25', '122e6453-9c62-4ad9-ba16-c082be08e971', 'caecf377-4765-4eee-9aff-169cd413c434'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:02:46 devstack sudo[100988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a
Sep 09 04:02:46 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:02:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:02:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:02:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:02:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:02:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:47 devstack sudo[100990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:02:47 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:47 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a" returned: 0 in 0.498s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:47 devstack sudo[100996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a
Sep 09 04:02:47 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:47 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.419s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:47 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:02:47 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Deleted volume successfully.
Sep 09 04:02:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fb94a88c-a102-45b7-9959-a3a1ef30f6b5 tempest-TestServerVolumeAttachmentScenario-619977674 None] Lock "cinder-c831508b-aec2-49bc-91d8-5006d775e4e8-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:02:47 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a" returned: 0 in 0.592s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "cinder-quobyte-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a" released by "delete_volume" :: held 1.144s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:02:48 devstack cinder-volume[87558]: WARNING cinder.quota [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2127497956-325319886 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2127497956-325319886, it is now deprecated. Please use the default quota class for default quota.
Sep 09 04:02:48 devstack cinder-volume[87558]: WARNING cinder.quota [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2127497956-325319886 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2127497956-325319886, it is now deprecated. Please use the default quota class for default quota.
Sep 09 04:02:48 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Created reservations ['43817ceb-b5cc-49e5-ae35-7be15d24c7ba', '7b130c17-7396-423b-9eff-e7a701e40b82', 'f811ded4-15da-417a-b070-5e25038167f1', 'f8c1d025-6a5d-47e9-9ef4-8b6f5bfe597b'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:02:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:02:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:02:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:02:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:02:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:02:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:02:48 devstack sudo[101058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:02:48 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:02:48 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root
Sep 09 04:02:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.355s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:02:48 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:02:48 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Deleted volume successfully.
Sep 09 04:02:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f1ad5a2a-f33f-47ea-9ad0-9805cdcb82a9 tempest-TestInstancesWithCinderVolumes-1860854434 None] Lock "cinder-d74ba453-c2cd-4e47-bbfa-f9811bc4d40a-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:02:58 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=61,cinder:UPDATE=44,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:02:58 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=52,cinder:UPDATE=49,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:03:16 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:03:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Flow 'volume_create_manager' (a4bec85a-035d-4887-8cc7-04149555aa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:03:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a17925-22e0-4d5c-918e-7eae767de31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a17925-22e0-4d5c-918e-7eae767de31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-907451174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6239b0-f7a9-408b-8257-9fb087fbbacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4005849666af44728de4a551164d952c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:03:17Z,use_quota=True,user_id='cde3672f26284c5f93027b6bf9319e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8814ba-abb9-4771-9b0c-93ae127c7cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8814ba-abb9-4771-9b0c-93ae127c7cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9004d4-f13a-437a-ac40-63cb78d5ea8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9004d4-f13a-437a-ac40-63cb78d5ea8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e6239b0-f7a9-408b-8257-9fb087fbbacb', 'volume_name': 'volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787d3c73-63fb-4709-9f12-522cad34be04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787d3c73-63fb-4709-9f12-522cad34be04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c36e54c-b7ef-403d-b59e-a400bcd63541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:17 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Volume 3e6239b0-f7a9-408b-8257-9fb087fbbacb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb', 'volume_size': 1}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-907451174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6239b0-f7a9-408b-8257-9fb087fbbacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4005849666af44728de4a551164d952c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:03:17Z,use_quota=True,user_id='cde3672f26284c5f93027b6bf9319e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Creating volume 3e6239b0-f7a9-408b-8257-9fb087fbbacb {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:03:17 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:17 devstack sudo[101151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb 1073741824
Sep 09 04:03:17 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:17 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb 1073741824" returned: 0 in 0.628s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:17 devstack sudo[101156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb
Sep 09 04:03:17 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:18 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb" returned: 0 in 0.289s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:03:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c36e54c-b7ef-403d-b59e-a400bcd63541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadc30c7-1d5d-4300-86df-7b27104b2c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:18 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Volume volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb (3e6239b0-f7a9-408b-8257-9fb087fbbacb): created successfully
Sep 09 04:03:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadc30c7-1d5d-4300-86df-7b27104b2c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Flow 'volume_create_manager' (a4bec85a-035d-4887-8cc7-04149555aa51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:03:18 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-07a09e10-9b73-49e2-bca7-7278458c0721 tempest-AttachVolumeTestJSON-1842060037 None] Created volume successfully.
Sep 09 04:03:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-adae52d0-e4ec-4d88-a9f9-80d5b73a9115 req-f137578d-d39a-4be7-8c67-56b08e0aa7a1 tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-adae52d0-e4ec-4d88-a9f9-80d5b73a9115 req-f137578d-d39a-4be7-8c67-56b08e0aa7a1 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-adae52d0-e4ec-4d88-a9f9-80d5b73a9115 req-f137578d-d39a-4be7-8c67-56b08e0aa7a1 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-adae52d0-e4ec-4d88-a9f9-80d5b73a9115 req-f137578d-d39a-4be7-8c67-56b08e0aa7a1 tempest-AttachVolumeTestJSON-1842060037 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2888a4f3-e636-43af-88c4-104d6afdcbb8', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 04:03:19 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-adae52d0-e4ec-4d88-a9f9-80d5b73a9115 req-f137578d-d39a-4be7-8c67-56b08e0aa7a1 tempest-AttachVolumeTestJSON-1842060037 None] attachment_update completed successfully.
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Flow 'volume_create_manager' (1fdf558d-0b30-408e-ba35-935ea9cfdf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2392f15-2321-4137-8b23-2183be07ac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2392f15-2321-4137-8b23-2183be07ac2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-589072127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af6af9a-2a32-49ce-ac39-ec9e29e1676b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4005849666af44728de4a551164d952c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:03:23Z,use_quota=True,user_id='cde3672f26284c5f93027b6bf9319e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce00ae91-6719-44df-97b2-d812a2e8f28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce00ae91-6719-44df-97b2-d812a2e8f28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49597256-cf8a-459f-b15b-9ddc9c099643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49597256-cf8a-459f-b15b-9ddc9c099643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af6af9a-2a32-49ce-ac39-ec9e29e1676b', 'volume_name': 'volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d158076-b6b4-4e67-bc9b-d2cf5236dea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d158076-b6b4-4e67-bc9b-d2cf5236dea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7d21eb-4dfc-46b0-b38a-e27beb64a709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:22 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Volume 1af6af9a-2a32-49ce-ac39-ec9e29e1676b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b', 'volume_size': 1}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-589072127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af6af9a-2a32-49ce-ac39-ec9e29e1676b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4005849666af44728de4a551164d952c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:03:23Z,use_quota=True,user_id='cde3672f26284c5f93027b6bf9319e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Creating volume 1af6af9a-2a32-49ce-ac39-ec9e29e1676b {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:03:22 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:03:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:22 devstack sudo[101553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b 1073741824
Sep 09 04:03:22 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b 1073741824" returned: 0 in 0.550s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:23 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:23 devstack sudo[101559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b
Sep 09 04:03:23 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:23 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b" returned: 0 in 0.318s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:03:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7d21eb-4dfc-46b0-b38a-e27beb64a709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343f107b-054a-4e19-bc55-b47b510047de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:23 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Volume volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b (1af6af9a-2a32-49ce-ac39-ec9e29e1676b): created successfully
Sep 09 04:03:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343f107b-054a-4e19-bc55-b47b510047de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:23 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Flow 'volume_create_manager' (1fdf558d-0b30-408e-ba35-935ea9cfdf89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:03:23 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-66e5b36c-9c0d-41c8-8f43-ceef0b1b1b74 tempest-AttachVolumeTestJSON-1842060037 None] Created volume successfully.
Sep 09 04:03:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-6722bf4e-b5af-4d93-b3c4-35e4ff313aa4 req-3a342a10-46fa-4786-8797-a6e53bfc3c46 tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-6722bf4e-b5af-4d93-b3c4-35e4ff313aa4 req-3a342a10-46fa-4786-8797-a6e53bfc3c46 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-6722bf4e-b5af-4d93-b3c4-35e4ff313aa4 req-3a342a10-46fa-4786-8797-a6e53bfc3c46 tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-6722bf4e-b5af-4d93-b3c4-35e4ff313aa4 req-3a342a10-46fa-4786-8797-a6e53bfc3c46 tempest-AttachVolumeTestJSON-1842060037 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b03fd218-8d72-4c06-8135-8905130905b8', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 04:03:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-6722bf4e-b5af-4d93-b3c4-35e4ff313aa4 req-3a342a10-46fa-4786-8797-a6e53bfc3c46 tempest-AttachVolumeTestJSON-1842060037 None] attachment_update completed successfully.
Sep 09 04:03:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:03:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:03:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:03:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:27 devstack sudo[101582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:03:27 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:27 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.315s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:03:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:03:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 04:03:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 04:03:28 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-d81eea64-cb33-4f2d-8600-7c25a0af23fa req-a18a4691-7684-4bda-868d-9ba2def44d4c tempest-AttachVolumeTestJSON-1842060037 None] Terminate volume connection completed successfully.
Sep 09 04:03:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-d81eea64-cb33-4f2d-8600-7c25a0af23fa req-a18a4691-7684-4bda-868d-9ba2def44d4c tempest-AttachVolumeTestJSON-1842060037 None] Deleting attachment 2888a4f3-e636-43af-88c4-104d6afdcbb8. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 04:03:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-36a401d8-65c5-4249-bef1-9ccae37a42d4 req-e20edd90-ecf5-4cfc-90c8-aa801d3ac2d3 tempest-AttachVolumeTestJSON-1842060037 None] Terminate volume connection completed successfully.
Sep 09 04:03:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-36a401d8-65c5-4249-bef1-9ccae37a42d4 req-e20edd90-ecf5-4cfc-90c8-aa801d3ac2d3 tempest-AttachVolumeTestJSON-1842060037 None] Deleting attachment b03fd218-8d72-4c06-8135-8905130905b8. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 04:03:35 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:03:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Flow 'volume_create_manager' (a8dc96eb-0158-4766-adfd-929b5deacbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:03:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30336685-2544-4eee-8b96-2da9165bc7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30336685-2544-4eee-8b96-2da9165bc7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1309115462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242095d9352c457b9492d69709f9725d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:03:35Z,use_quota=True,user_id='b571e84d9c1943f3a960ab25f3f4ac31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2f1537-0024-410b-93b2-901d16244b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2f1537-0024-410b-93b2-901d16244b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4770ee-9421-45d8-8f06-dbb0e024b644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:35 devstack cinder-volume[87558]: DEBUG cinder.image.glance [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Creating Keystone auth plugin from conf {{(pid=87558) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 04:03:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4770ee-9421-45d8-8f06-dbb0e024b644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6', 'volume_name': 'volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01a5310>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700a0b1d-6ec2-456d-96c5-9b460e7c66aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700a0b1d-6ec2-456d-96c5-9b460e7c66aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305c684f-e37f-4385-b233-1f4239632f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:35 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Volume 55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01a5310>}
Sep 09 04:03:35 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Trying to clone 55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 from image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]). {{(pid=87558) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 04:03:36 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Image download 20.69 MB at 20.69 MB/s
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdc37c8-c1b6-4368-aba8-9e02959f6aa0]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "cinder-1af6af9a-2a32-49ce-ac39-ec9e29e1676b-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Lock "cinder-1af6af9a-2a32-49ce-ac39-ec9e29e1676b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "cinder-quobyte-1af6af9a-2a32-49ce-ac39-ec9e29e1676b" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:03:36 devstack sudo[101648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD
Sep 09 04:03:36 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Lock "cinder-quobyte-1af6af9a-2a32-49ce-ac39-ec9e29e1676b" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[75649e56-629e-4cc0-93fb-8b967b33f487]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:36 devstack sudo[101650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b
Sep 09 04:03:36 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:36 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Temporary image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 is fetched for user b571e84d9c1943f3a960ab25f3f4ac31. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[651d32fa-dac2-4cb1-bef0-e20882260518]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:36 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b" returned: 0 in 0.428s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:36 devstack sudo[101655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD
Sep 09 04:03:36 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:36 devstack sudo[101660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b
Sep 09 04:03:36 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:37 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:37 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1309115462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242095d9352c457b9492d69709f9725d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:03:35Z,use_quota=True,user_id='b571e84d9c1943f3a960ab25f3f4ac31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Creating volume 55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:03:37 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1af6af9a-2a32-49ce-ac39-ec9e29e1676b" returned: 0 in 0.318s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:37 devstack sudo[101666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 1073741824
Sep 09 04:03:37 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Lock "cinder-quobyte-1af6af9a-2a32-49ce-ac39-ec9e29e1676b" released by "delete_volume" :: held 0.823s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Created reservations ['a9b79d80-4fdf-4469-adae-87f05b1d05ac', 'f4ea67e5-2516-40c8-890e-1ad397def866', '8ef44b48-d3cb-4822-a55b-fdaf6181a543', 'd02eeea6-db74-41d5-a8c3-4ca2af2be532'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:37 devstack sudo[101668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:03:37 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "cinder-3e6239b0-f7a9-408b-8257-9fb087fbbacb-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Lock "cinder-3e6239b0-f7a9-408b-8257-9fb087fbbacb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "cinder-quobyte-3e6239b0-f7a9-408b-8257-9fb087fbbacb" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Lock "cinder-quobyte-3e6239b0-f7a9-408b-8257-9fb087fbbacb" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:03:37 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.321s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:03:37 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Deleted volume successfully.
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[761cba95-b2cd-4f0d-b1ee-9e7dfc78fa8b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-faa7ecb9-7bbf-4cb5-913b-14f06ab7e5fc tempest-AttachVolumeTestJSON-1842060037 None] Lock "cinder-1af6af9a-2a32-49ce-ac39-ec9e29e1676b-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:03:37 devstack sudo[101678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb
Sep 09 04:03:37 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:37 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 1073741824" returned: 0 in 0.743s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:37 devstack sudo[101687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6
Sep 09 04:03:37 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:38 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb" returned: 0 in 0.537s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:38 devstack sudo[101695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb
Sep 09 04:03:38 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:38 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6" returned: 0 in 0.433s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Attempting download of 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}])) to volume 55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfb68ac-1f2d-4eda-8fb2-503d24147a38]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_mftptre6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:38 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3e6239b0-f7a9-408b-8257-9fb087fbbacb" returned: 0 in 0.371s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Lock "cinder-quobyte-3e6239b0-f7a9-408b-8257-9fb087fbbacb" released by "delete_volume" :: held 0.983s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:03:38 devstack sudo[101700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_mftptre6
Sep 09 04:03:38 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Created reservations ['10741876-5882-4479-a8bb-cd20856fe559', '010a2821-0913-47e8-9ba7-03bdbe62cfe3', 'e67816fb-5539-46b6-afec-02b3230c11d5', 'acce414f-8191-418d-b78f-3087e6761ca9'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:38 devstack sudo[101703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:03:38 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:38 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_mftptre6" returned: 0 in 0.410s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_mftptre6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:38 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:38 devstack sudo[101707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_mftptre6
Sep 09 04:03:38 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.255s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:03:38 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Deleted volume successfully.
Sep 09 04:03:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c67f9bed-a4fc-4e92-9e13-a085bc65e1ec tempest-AttachVolumeTestJSON-1842060037 None] Lock "cinder-3e6239b0-f7a9-408b-8257-9fb087fbbacb-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:03:39 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_mftptre6" returned: 1 in 0.364s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_mftptre6' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:03:39 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c39ce97-de9e-4912-ad59-27935492dc9a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:03:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:39 devstack sudo[101712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD
Sep 09 04:03:39 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:39 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:39 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 was qcow2, converting to qcow2 {{(pid=87558) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 04:03:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:39 devstack sudo[101717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6
Sep 09 04:03:39 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "cinder-c6aa965e-1c97-4788-ad34-93fff1743842-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:03:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Lock "cinder-c6aa965e-1c97-4788-ad34-93fff1743842-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:03:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "cinder-quobyte-c6aa965e-1c97-4788-ad34-93fff1743842" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:03:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Lock "cinder-quobyte-c6aa965e-1c97-4788-ad34-93fff1743842" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:03:39 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb31df3e-e040-4b84-b082-5addef452305]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:03:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c6aa965e-1c97-4788-ad34-93fff1743842 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:40 devstack sudo[101724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c6aa965e-1c97-4788-ad34-93fff1743842
Sep 09 04:03:40 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:40 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c6aa965e-1c97-4788-ad34-93fff1743842" returned: 0 in 0.497s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c6aa965e-1c97-4788-ad34-93fff1743842 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:40 devstack sudo[101742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c6aa965e-1c97-4788-ad34-93fff1743842
Sep 09 04:03:40 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:41 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c6aa965e-1c97-4788-ad34-93fff1743842" returned: 0 in 0.715s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Lock "cinder-quobyte-c6aa965e-1c97-4788-ad34-93fff1743842" released by "delete_volume" :: held 1.277s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:03:41 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Created reservations ['f63f7eb8-c126-4344-90d5-795fd8cb980c', '347d6f84-81f3-4241-8695-91a1e517dd3d', 'aedd094f-a754-445f-8ef4-e528ad399008', 'aa7fb2fe-e0f7-4cfd-b7f7-df94051141e0'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:03:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:03:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:03:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:41 devstack sudo[101797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:03:41 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:41 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.395s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:41 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:03:41 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Deleted volume successfully.
Sep 09 04:03:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2757aafd-c9fd-4a48-a72d-719e5404321f tempest-AttachVolumeTestJSON-1842060037 None] Lock "cinder-c6aa965e-1c97-4788-ad34-93fff1743842-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:03:42 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6" returned: 0 in 2.698s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:42 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_n93r95vfdevstack@QuobyteHD, size 112.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 04:03:42 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Converted 112.00 MB image at 41.49 MB/s
Sep 09 04:03:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:42 devstack sudo[101805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 1G
Sep 09 04:03:42 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:42 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 1G" returned: 0 in 0.393s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:42 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Downloaded image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}])) to volume 55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 successfully. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 04:03:42 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Temporary image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 for user b571e84d9c1943f3a960ab25f3f4ac31 is deleted. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 04:03:42 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Marking volume 55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 as bootable. {{(pid=87558) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 04:03:42 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Copying metadata from image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 to 55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6. {{(pid=87558) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 04:03:42 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Creating volume glance metadata for volume 55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 backed by image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87558) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 04:03:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305c684f-e37f-4385-b233-1f4239632f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01a5310>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fa1f15-8f3c-4e1c-b1f9-fb19821a3ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:42 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Volume volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 (55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6): created successfully
Sep 09 04:03:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fa1f15-8f3c-4e1c-b1f9-fb19821a3ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Flow 'volume_create_manager' (a8dc96eb-0158-4766-adfd-929b5deacbdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:03:42 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-51b1d64d-e578-441b-8b89-2c1a00ea55f2 tempest-TestShelveInstance-1472863577 None] Created volume successfully.
Sep 09 04:03:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-e91ac0cc-1605-4c0a-962a-8daab92b9406 req-41e50b52-6690-4175-aa27-e135898c6fb4 tempest-TestShelveInstance-1472863577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-e91ac0cc-1605-4c0a-962a-8daab92b9406 req-41e50b52-6690-4175-aa27-e135898c6fb4 tempest-TestShelveInstance-1472863577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-e91ac0cc-1605-4c0a-962a-8daab92b9406 req-41e50b52-6690-4175-aa27-e135898c6fb4 tempest-TestShelveInstance-1472863577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-e91ac0cc-1605-4c0a-962a-8daab92b9406 req-41e50b52-6690-4175-aa27-e135898c6fb4 tempest-TestShelveInstance-1472863577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ddfc821-753f-4e49-a03f-a5c4b7ea19cd', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 04:03:48 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-e91ac0cc-1605-4c0a-962a-8daab92b9406 req-41e50b52-6690-4175-aa27-e135898c6fb4 tempest-TestShelveInstance-1472863577 None] attachment_update completed successfully.
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Flow 'volume_create_manager' (c2b59802-430c-42c0-b64e-55c15e6f7b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ec6357-26af-445a-9343-9773ffa51990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ec6357-26af-445a-9343-9773ffa51990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1759007246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00ac230-79d8-4d20-853f-86a76624dee1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='06c833e4cdf24df9be4c7b116b6083fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:03:52Z,use_quota=True,user_id='9160cfed222347b8bfee514ddad9a110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da8e047-ff93-4eaa-a53f-4ff1954e4286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da8e047-ff93-4eaa-a53f-4ff1954e4286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79717e1-d932-420e-8e18-591c80a8b2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79717e1-d932-420e-8e18-591c80a8b2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f00ac230-79d8-4d20-853f-86a76624dee1', 'volume_name': 'volume-f00ac230-79d8-4d20-853f-86a76624dee1', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08965ad-a83c-4f9c-892e-5d775023a4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08965ad-a83c-4f9c-892e-5d775023a4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace6ba60-c8ca-41a6-8f02-38d9b97d0e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:52 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Volume f00ac230-79d8-4d20-853f-86a76624dee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f00ac230-79d8-4d20-853f-86a76624dee1', 'volume_size': 1}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1759007246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00ac230-79d8-4d20-853f-86a76624dee1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='06c833e4cdf24df9be4c7b116b6083fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:03:52Z,use_quota=True,user_id='9160cfed222347b8bfee514ddad9a110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Creating volume f00ac230-79d8-4d20-853f-86a76624dee1 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:03:52 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:03:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f00ac230-79d8-4d20-853f-86a76624dee1 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:52 devstack sudo[102258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f00ac230-79d8-4d20-853f-86a76624dee1 1073741824
Sep 09 04:03:52 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:53 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f00ac230-79d8-4d20-853f-86a76624dee1 1073741824" returned: 0 in 1.001s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f00ac230-79d8-4d20-853f-86a76624dee1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:53 devstack sudo[102286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f00ac230-79d8-4d20-853f-86a76624dee1
Sep 09 04:03:53 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:54 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f00ac230-79d8-4d20-853f-86a76624dee1" returned: 0 in 0.318s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:03:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace6ba60-c8ca-41a6-8f02-38d9b97d0e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00ac230-79d8-4d20-853f-86a76624dee1', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d400b8-3929-46a0-9ad0-7b460f43dd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:03:54 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Volume volume-f00ac230-79d8-4d20-853f-86a76624dee1 (f00ac230-79d8-4d20-853f-86a76624dee1): created successfully
Sep 09 04:03:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d400b8-3929-46a0-9ad0-7b460f43dd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:03:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Flow 'volume_create_manager' (c2b59802-430c-42c0-b64e-55c15e6f7b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:03:54 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-51bb2f04-6d4f-43dc-9b06-94bfb0a57bfc req-2563054d-3624-455a-9bb6-a6f25f4aa3f7 tempest-VolumesGetTestJSON-850017884 None] Created volume successfully.
Sep 09 04:03:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Acquiring lock "cinder-f00ac230-79d8-4d20-853f-86a76624dee1-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:03:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Lock "cinder-f00ac230-79d8-4d20-853f-86a76624dee1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:03:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Acquiring lock "cinder-quobyte-f00ac230-79d8-4d20-853f-86a76624dee1" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:03:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Lock "cinder-quobyte-f00ac230-79d8-4d20-853f-86a76624dee1" acquired by "delete_volume" :: waited 0.039s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:03:55 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ee0a27-c6af-42be-a8df-72eee1a21296]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:03:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f00ac230-79d8-4d20-853f-86a76624dee1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:55 devstack sudo[102306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f00ac230-79d8-4d20-853f-86a76624dee1
Sep 09 04:03:55 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:55 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f00ac230-79d8-4d20-853f-86a76624dee1" returned: 0 in 0.417s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f00ac230-79d8-4d20-853f-86a76624dee1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:55 devstack sudo[102311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f00ac230-79d8-4d20-853f-86a76624dee1
Sep 09 04:03:55 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:55 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f00ac230-79d8-4d20-853f-86a76624dee1" returned: 0 in 0.302s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Lock "cinder-quobyte-f00ac230-79d8-4d20-853f-86a76624dee1" released by "delete_volume" :: held 0.786s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:03:55 devstack cinder-volume[87558]: DEBUG cinder.quota [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Created reservations ['0a1c8747-7efa-49ea-808f-ce2d8e497522', 'd73aa81f-5af2-4863-a845-a86b37d7a67a', 'd93beb78-2d8f-4e8a-81a3-e744298022e0', '4685edd3-cb82-4b5b-aadf-de9b05b06b92'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:03:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:03:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:03:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:03:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:03:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:03:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:03:56 devstack sudo[102314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:03:56 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:03:56 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root
Sep 09 04:03:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.325s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:03:56 devstack cinder-volume[87558]: DEBUG cinder.manager [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:03:56 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Deleted volume successfully.
Sep 09 04:03:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-89828e2e-9588-4d27-9c13-039336177dc7 req-d05120b7-30ce-4fbc-a79c-38f9f5f3a5a8 tempest-VolumesGetTestJSON-850017884 None] Lock "cinder-f00ac230-79d8-4d20-853f-86a76624dee1-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:04:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-bdb11b40-a280-4509-8874-65a7a446ce57 tempest-BackendsCapabilitiesAdminTestsJSON-1907220519 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.423496246338, 'free_capacity_gb': 1773.423496246338, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87558) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 09 04:04:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b34d1305-9e48-4a83-9a88-ae432d7de13c tempest-BackendsCapabilitiesAdminTestsJSON-1907220519 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.423496246338, 'free_capacity_gb': 1773.423496246338, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87558) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 09 04:04:05 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Flow 'volume_create_manager' (8faba6b1-e502-49f5-846a-a0cb54208ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb1c24c-6caf-4402-a281-17fde5e4e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb1c24c-6caf-4402-a281-17fde5e4e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1119261096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2906720-4534-4b34-8bf8-e2f8e783ed56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d60faf155f64fdfbea8119bc4d346cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:06Z,use_quota=True,user_id='00f07bd0819a407a8977ccba974a419c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22aa3fd6-58a4-4bc8-868d-0b8a0164e1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22aa3fd6-58a4-4bc8-868d-0b8a0164e1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20add7f-3bf9-4dde-9baa-b5802b304213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20add7f-3bf9-4dde-9baa-b5802b304213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2906720-4534-4b34-8bf8-e2f8e783ed56', 'volume_name': 'volume-b2906720-4534-4b34-8bf8-e2f8e783ed56', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b4320b-1216-4870-a254-0e8469d358bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b4320b-1216-4870-a254-0e8469d358bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362476e5-f317-48ff-a4ba-f17ab03cab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:06 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Volume b2906720-4534-4b34-8bf8-e2f8e783ed56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2906720-4534-4b34-8bf8-e2f8e783ed56', 'volume_size': 1}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1119261096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2906720-4534-4b34-8bf8-e2f8e783ed56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d60faf155f64fdfbea8119bc4d346cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:06Z,use_quota=True,user_id='00f07bd0819a407a8977ccba974a419c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Creating volume b2906720-4534-4b34-8bf8-e2f8e783ed56 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:04:06 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b2906720-4534-4b34-8bf8-e2f8e783ed56 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:06 devstack sudo[102322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b2906720-4534-4b34-8bf8-e2f8e783ed56 1073741824
Sep 09 04:04:06 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:06 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b2906720-4534-4b34-8bf8-e2f8e783ed56 1073741824" returned: 0 in 0.504s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b2906720-4534-4b34-8bf8-e2f8e783ed56 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:06 devstack sudo[102328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b2906720-4534-4b34-8bf8-e2f8e783ed56
Sep 09 04:04:06 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:06 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b2906720-4534-4b34-8bf8-e2f8e783ed56" returned: 0 in 0.318s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362476e5-f317-48ff-a4ba-f17ab03cab47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2906720-4534-4b34-8bf8-e2f8e783ed56', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a769a49a-8c2c-4f0f-931c-bfdf6516b8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:06 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Volume volume-b2906720-4534-4b34-8bf8-e2f8e783ed56 (b2906720-4534-4b34-8bf8-e2f8e783ed56): created successfully
Sep 09 04:04:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a769a49a-8c2c-4f0f-931c-bfdf6516b8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Flow 'volume_create_manager' (8faba6b1-e502-49f5-846a-a0cb54208ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:07 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-18f6fd40-6fa5-4ff3-b075-ec80b19ec34b tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Created volume successfully.
Sep 09 04:04:08 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=62,cinder:UPDATE=44,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:04:08 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=58,cinder:UPDATE=62,cinder:DELETE=5,cinder:INSERT=14 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:04:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-212dd791-6c55-47ec-aa9c-7e67fd3f91ed req-c62dad5a-6391-4c97-a699-0e7a96e79eff tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-212dd791-6c55-47ec-aa9c-7e67fd3f91ed req-c62dad5a-6391-4c97-a699-0e7a96e79eff tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-212dd791-6c55-47ec-aa9c-7e67fd3f91ed req-c62dad5a-6391-4c97-a699-0e7a96e79eff tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-212dd791-6c55-47ec-aa9c-7e67fd3f91ed req-c62dad5a-6391-4c97-a699-0e7a96e79eff tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-b2906720-4534-4b34-8bf8-e2f8e783ed56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'efa09217-e932-4353-bd0d-6e52c2562e5d', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 04:04:09 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-212dd791-6c55-47ec-aa9c-7e67fd3f91ed req-c62dad5a-6391-4c97-a699-0e7a96e79eff tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] attachment_update completed successfully.
Sep 09 04:04:11 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-9d0f39b2-bf8b-4762-96bb-bf3fd2334c3e req-f1d1bb1e-4d6a-41cd-a65f-83a560473030 tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Terminate volume connection completed successfully.
Sep 09 04:04:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-9d0f39b2-bf8b-4762-96bb-bf3fd2334c3e req-f1d1bb1e-4d6a-41cd-a65f-83a560473030 tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Deleting attachment efa09217-e932-4353-bd0d-6e52c2562e5d. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 04:04:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Acquiring lock "cinder-b2906720-4534-4b34-8bf8-e2f8e783ed56-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:04:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Lock "cinder-b2906720-4534-4b34-8bf8-e2f8e783ed56-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:04:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Acquiring lock "cinder-quobyte-b2906720-4534-4b34-8bf8-e2f8e783ed56" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:04:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Lock "cinder-quobyte-b2906720-4534-4b34-8bf8-e2f8e783ed56" acquired by "delete_volume" :: waited 0.037s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:04:12 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cec71d-ff4a-4949-8b43-d7c4ffd9143d]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:04:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b2906720-4534-4b34-8bf8-e2f8e783ed56 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:12 devstack sudo[102418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b2906720-4534-4b34-8bf8-e2f8e783ed56
Sep 09 04:04:12 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:12 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b2906720-4534-4b34-8bf8-e2f8e783ed56" returned: 0 in 0.414s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b2906720-4534-4b34-8bf8-e2f8e783ed56 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:12 devstack sudo[102423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b2906720-4534-4b34-8bf8-e2f8e783ed56
Sep 09 04:04:12 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:13 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b2906720-4534-4b34-8bf8-e2f8e783ed56" returned: 0 in 0.276s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Lock "cinder-quobyte-b2906720-4534-4b34-8bf8-e2f8e783ed56" released by "delete_volume" :: held 0.740s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:04:13 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Created reservations ['459e0368-9c96-4749-8ddd-02f79991b52f', '24bff369-64de-430d-b7a0-76fc68d4b94e', '9e914505-b51c-4769-8b44-d0fc670e3e3e', '1304ee84-d89c-49a1-9a7d-e641c36ab08a'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:04:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:04:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:04:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:13 devstack sudo[102426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:04:13 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:13 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.264s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:13 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:04:13 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Deleted volume successfully.
Sep 09 04:04:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-47cd0d44-9157-4856-a31d-17d5c958110f tempest-TestServerVolumeAttachScenarioOldVersion-344263687 None] Lock "cinder-b2906720-4534-4b34-8bf8-e2f8e783ed56-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:04:23 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=15,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:04:23 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=9,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:04:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:04:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:04:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:04:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:27 devstack sudo[102485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:04:27 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:27 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.276s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:04:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:04:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 04:04:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 04:04:31 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-f4b2f1f2-29f7-4dea-9a46-15f51fc71d69 req-063b8bbd-08bb-48ac-8115-5c1434207940 tempest-TestShelveInstance-1472863577 None] Terminate volume connection completed successfully.
Sep 09 04:04:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-f4b2f1f2-29f7-4dea-9a46-15f51fc71d69 req-063b8bbd-08bb-48ac-8115-5c1434207940 tempest-TestShelveInstance-1472863577 None] Deleting attachment 4ddfc821-753f-4e49-a03f-a5c4b7ea19cd. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 04:04:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-07c45516-bb55-46b8-a73c-947be4306142 req-b7e9d7bb-311d-4431-8bce-400cc2db2425 tempest-TestShelveInstance-1472863577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-07c45516-bb55-46b8-a73c-947be4306142 req-b7e9d7bb-311d-4431-8bce-400cc2db2425 tempest-TestShelveInstance-1472863577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-07c45516-bb55-46b8-a73c-947be4306142 req-b7e9d7bb-311d-4431-8bce-400cc2db2425 tempest-TestShelveInstance-1472863577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-07c45516-bb55-46b8-a73c-947be4306142 req-b7e9d7bb-311d-4431-8bce-400cc2db2425 tempest-TestShelveInstance-1472863577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f481eec-4931-435d-a7be-6a6949581563', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 04:04:34 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-07c45516-bb55-46b8-a73c-947be4306142 req-b7e9d7bb-311d-4431-8bce-400cc2db2425 tempest-TestShelveInstance-1472863577 None] attachment_update completed successfully.
Sep 09 04:04:38 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:04:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Flow 'volume_create_manager' (163d7b36-52e5-486b-951c-c91b47fb6b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf297644-a575-42c3-acf1-7a4f23a35576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf297644-a575-42c3-acf1-7a4f23a35576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f18747-5057-42dd-a110-f724758ebef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171240c6b2f64ad0801a1ae1c6991274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:38Z,use_quota=True,user_id='3e768fdfa4f944db91f4334df1e70247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca463493-6cc3-4403-908e-6a6d30dbebc9),volume_type_id=ca463493-6cc3-4403-908e-6a6d30dbebc9)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d8d0b3-3134-4809-835d-d27f69850732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d8d0b3-3134-4809-835d-d27f69850732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbb3dfa-b11c-41dc-bc84-203d91940049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:38 devstack cinder-volume[87558]: DEBUG cinder.image.glance [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Creating Keystone auth plugin from conf {{(pid=87558) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 04:04:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbb3dfa-b11c-41dc-bc84-203d91940049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '93f18747-5057-42dd-a110-f724758ebef4', 'volume_name': 'volume-93f18747-5057-42dd-a110-f724758ebef4', 'volume_size': 1, 'image_id': '4893ba4b-72b1-4cef-b9bc-dcf926ac3000', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4893ba4b-72b1-4cef-b9bc-dcf926ac3000', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '863b2306d295dbe39551b27358af3ab8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '171240c6b2f64ad0801a1ae1c6991274', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c8b1b2f336bd59387bfefb394a6cfc6700cf29ee65d2a6549bc7d6c77f62a4cbbb3b6d2ce865a211502596d41db4172e4a2c6d4235955015c21651da2195c16', 'id': '4893ba4b-72b1-4cef-b9bc-dcf926ac3000', 'created_at': datetime.datetime(2026, 9, 9, 2, 4, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 2, 4, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4893ba4b-72b1-4cef-b9bc-dcf926ac3000/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01094c0>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e2f2e8-b09e-43c9-83d4-e8a239007e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e2f2e8-b09e-43c9-83d4-e8a239007e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae7f376-d63a-42db-bec0-28986d2ab6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:39 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Volume 93f18747-5057-42dd-a110-f724758ebef4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-93f18747-5057-42dd-a110-f724758ebef4', 'volume_size': 1, 'image_id': '4893ba4b-72b1-4cef-b9bc-dcf926ac3000', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4893ba4b-72b1-4cef-b9bc-dcf926ac3000', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '863b2306d295dbe39551b27358af3ab8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '171240c6b2f64ad0801a1ae1c6991274', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c8b1b2f336bd59387bfefb394a6cfc6700cf29ee65d2a6549bc7d6c77f62a4cbbb3b6d2ce865a211502596d41db4172e4a2c6d4235955015c21651da2195c16', 'id': '4893ba4b-72b1-4cef-b9bc-dcf926ac3000', 'created_at': datetime.datetime(2026, 9, 9, 2, 4, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 2, 4, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4893ba4b-72b1-4cef-b9bc-dcf926ac3000/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01094c0>}
Sep 09 04:04:39 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Trying to clone 93f18747-5057-42dd-a110-f724758ebef4 from image 4893ba4b-72b1-4cef-b9bc-dcf926ac3000 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4893ba4b-72b1-4cef-b9bc-dcf926ac3000', 'metadata': {}}]). {{(pid=87558) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 04:04:39 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 04:04:39 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Image download 0.00 MB at 0.00 MB/s
Sep 09 04:04:39 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7138cb-5599-4da1-b384-835d858a617b]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:04:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:39 devstack sudo[102974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD
Sep 09 04:04:39 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:39 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:40 devstack sudo[102978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD
Sep 09 04:04:40 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:40 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD" returned: 1 in 0.593s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:04:40 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Temporary image 4893ba4b-72b1-4cef-b9bc-dcf926ac3000 is fetched for user 3e768fdfa4f944db91f4334df1e70247. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 04:04:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c6f16a-2477-420e-b7fd-b719ec98f55c]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:04:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:40 devstack sudo[102989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD
Sep 09 04:04:40 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:41 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD" returned: 0 in 0.905s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:41 devstack sudo[103011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD
Sep 09 04:04:41 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:41 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f18747-5057-42dd-a110-f724758ebef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171240c6b2f64ad0801a1ae1c6991274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:38Z,use_quota=True,user_id='3e768fdfa4f944db91f4334df1e70247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca463493-6cc3-4403-908e-6a6d30dbebc9),volume_type_id=ca463493-6cc3-4403-908e-6a6d30dbebc9)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Creating volume 93f18747-5057-42dd-a110-f724758ebef4 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:04:41 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:04:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:41 devstack sudo[103016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4 1073741824
Sep 09 04:04:41 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:42 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4 1073741824" returned: 0 in 0.606s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:42 devstack sudo[103021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4
Sep 09 04:04:42 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:42 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4" returned: 0 in 0.322s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:04:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:42 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Attempting download of 4893ba4b-72b1-4cef-b9bc-dcf926ac3000 ((None, [{'url': 'file:///opt/stack/data/glance/images/4893ba4b-72b1-4cef-b9bc-dcf926ac3000', 'metadata': {}}])) to volume 93f18747-5057-42dd-a110-f724758ebef4. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 04:04:42 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b28fd96-9fc0-4a00-b4c1-6cf267a9e395]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:04:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_zt3_k4vf {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:43 devstack sudo[103025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_zt3_k4vf
Sep 09 04:04:43 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:43 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_zt3_k4vf" returned: 0 in 0.620s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_zt3_k4vf {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:43 devstack sudo[103050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_zt3_k4vf
Sep 09 04:04:43 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:44 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_zt3_k4vf" returned: 1 in 0.862s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_zt3_k4vf' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:04:44 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[666560b4-45aa-4570-9934-5b7fb84f2b8d]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:04:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:44 devstack sudo[103094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD
Sep 09 04:04:44 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:45 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD" returned: 0 in 0.667s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:45 devstack sudo[103104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD
Sep 09 04:04:45 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:45 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD" returned: 1 in 0.453s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:04:45 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] 4893ba4b-72b1-4cef-b9bc-dcf926ac3000 was raw, converting to qcow2 {{(pid=87558) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 04:04:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:45 devstack sudo[103112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4
Sep 09 04:04:45 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:46 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4" returned: 0 in 0.580s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:46 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4893ba4b-72b1-4cef-b9bc-dcf926ac3000_t6rq0e7pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4 {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 04:04:46 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Converted 0.00 MB image at 0.00 MB/s
Sep 09 04:04:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:46 devstack sudo[103118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4 1G
Sep 09 04:04:46 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:46 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4 1G" returned: 0 in 0.364s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:46 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Downloaded image 4893ba4b-72b1-4cef-b9bc-dcf926ac3000 ((None, [{'url': 'file:///opt/stack/data/glance/images/4893ba4b-72b1-4cef-b9bc-dcf926ac3000', 'metadata': {}}])) to volume 93f18747-5057-42dd-a110-f724758ebef4 successfully. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 04:04:46 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Temporary image 4893ba4b-72b1-4cef-b9bc-dcf926ac3000 for user 3e768fdfa4f944db91f4334df1e70247 is deleted. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 04:04:46 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Marking volume 93f18747-5057-42dd-a110-f724758ebef4 as bootable. {{(pid=87558) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 04:04:46 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Copying metadata from image 4893ba4b-72b1-4cef-b9bc-dcf926ac3000 to 93f18747-5057-42dd-a110-f724758ebef4. {{(pid=87558) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 04:04:46 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Creating volume glance metadata for volume 93f18747-5057-42dd-a110-f724758ebef4 backed by image 4893ba4b-72b1-4cef-b9bc-dcf926ac3000 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4893ba4b-72b1-4cef-b9bc-dcf926ac3000', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '863b2306d295dbe39551b27358af3ab8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87558) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 04:04:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae7f376-d63a-42db-bec0-28986d2ab6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93f18747-5057-42dd-a110-f724758ebef4', 'volume_size': 1, 'image_id': '4893ba4b-72b1-4cef-b9bc-dcf926ac3000', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4893ba4b-72b1-4cef-b9bc-dcf926ac3000', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '863b2306d295dbe39551b27358af3ab8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '171240c6b2f64ad0801a1ae1c6991274', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c8b1b2f336bd59387bfefb394a6cfc6700cf29ee65d2a6549bc7d6c77f62a4cbbb3b6d2ce865a211502596d41db4172e4a2c6d4235955015c21651da2195c16', 'id': '4893ba4b-72b1-4cef-b9bc-dcf926ac3000', 'created_at': datetime.datetime(2026, 9, 9, 2, 4, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 2, 4, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4893ba4b-72b1-4cef-b9bc-dcf926ac3000/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01094c0>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7493294d-f6bf-491d-ae5e-40a8c4fcc2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:46 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Volume volume-93f18747-5057-42dd-a110-f724758ebef4 (93f18747-5057-42dd-a110-f724758ebef4): created successfully
Sep 09 04:04:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7493294d-f6bf-491d-ae5e-40a8c4fcc2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Flow 'volume_create_manager' (163d7b36-52e5-486b-951c-c91b47fb6b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:46 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-51b703e9-7913-45fc-be15-6c7d35bc4557 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Created volume successfully.
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Acquiring lock "cinder-93f18747-5057-42dd-a110-f724758ebef4-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Lock "cinder-93f18747-5057-42dd-a110-f724758ebef4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Acquiring lock "cinder-quobyte-93f18747-5057-42dd-a110-f724758ebef4" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Lock "cinder-quobyte-93f18747-5057-42dd-a110-f724758ebef4" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[771a6f4f-bbbd-4e94-a6df-8018490de0d9]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:47 devstack sudo[103123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4
Sep 09 04:04:47 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Flow 'volume_create_manager' (0c6899d9-c995-4429-8e74-cc3c8dffcc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec4e686-7287-4129-8c1e-01c031b0419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec4e686-7287-4129-8c1e-01c031b0419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1917498339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748f170c-e70b-4849-96d6-2368748011f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f35756dbc3946059ba54745973f9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:47Z,use_quota=True,user_id='402ad199137640c98d0b1afe3c38707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e8fe12-9d53-4141-920e-7d032e6e024e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e8fe12-9d53-4141-920e-7d032e6e024e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cbb4d78-84d7-412e-a410-b4b19d8f24cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cbb4d78-84d7-412e-a410-b4b19d8f24cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748f170c-e70b-4849-96d6-2368748011f9', 'volume_name': 'volume-748f170c-e70b-4849-96d6-2368748011f9', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aa98fe-7125-4862-9d53-0b54248f3f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aa98fe-7125-4862-9d53-0b54248f3f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437268b6-646e-42cb-8b6f-7c8762bb9e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:47 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Volume 748f170c-e70b-4849-96d6-2368748011f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748f170c-e70b-4849-96d6-2368748011f9', 'volume_size': 1}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1917498339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748f170c-e70b-4849-96d6-2368748011f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f35756dbc3946059ba54745973f9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:47Z,use_quota=True,user_id='402ad199137640c98d0b1afe3c38707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Creating volume 748f170c-e70b-4849-96d6-2368748011f9 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:04:47 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-748f170c-e70b-4849-96d6-2368748011f9 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:47 devstack sudo[103127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-748f170c-e70b-4849-96d6-2368748011f9 1073741824
Sep 09 04:04:47 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:47 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4" returned: 0 in 0.421s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:47 devstack sudo[103130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4
Sep 09 04:04:47 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:48 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-93f18747-5057-42dd-a110-f724758ebef4" returned: 0 in 0.315s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Lock "cinder-quobyte-93f18747-5057-42dd-a110-f724758ebef4" released by "delete_volume" :: held 0.803s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:04:48 devstack cinder-volume[87558]: WARNING cinder.quota [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 09 04:04:48 devstack cinder-volume[87558]: WARNING cinder.quota [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Created reservations ['74389161-a9f5-4942-9ef8-1adb3989587e', 'd81e2c85-00c4-4545-b881-7c2f947a6e1b', '6e0fe991-ed92-439b-b275-9982d5ed73bf', '8493475d-45f2-448d-8b32-5da16684d0f3'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:04:48 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-748f170c-e70b-4849-96d6-2368748011f9 1073741824" returned: 0 in 0.603s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:48 devstack sudo[103137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:04:48 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-748f170c-e70b-4849-96d6-2368748011f9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:48 devstack sudo[103139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-748f170c-e70b-4849-96d6-2368748011f9
Sep 09 04:04:48 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:48 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.417s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:04:48 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Deleted volume successfully.
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-33e1c89b-2c09-4bcc-8dca-01496e263458 tempest-VolumeAndVolumeTypeFromImageTest-1097926311 None] Lock "cinder-93f18747-5057-42dd-a110-f724758ebef4-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:04:48 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-748f170c-e70b-4849-96d6-2368748011f9" returned: 0 in 0.544s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437268b6-646e-42cb-8b6f-7c8762bb9e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748f170c-e70b-4849-96d6-2368748011f9', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd7660d-630d-42b7-991c-14649e0e3c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:48 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Volume volume-748f170c-e70b-4849-96d6-2368748011f9 (748f170c-e70b-4849-96d6-2368748011f9): created successfully
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd7660d-630d-42b7-991c-14649e0e3c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Flow 'volume_create_manager' (0c6899d9-c995-4429-8e74-cc3c8dffcc2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:48 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-cb426644-9103-4bd5-8a1a-c7b8c3414b69 tempest-VolumesActionsTest-674359614 None] Created volume successfully.
Sep 09 04:04:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-38082b23-f01d-4a08-9b2e-a41dfa1e38df tempest-VolumesActionsTest-674359614 None] Acquiring lock "cinder-748f170c-e70b-4849-96d6-2368748011f9" by "attach_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:04:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-38082b23-f01d-4a08-9b2e-a41dfa1e38df tempest-VolumesActionsTest-674359614 None] Lock "cinder-748f170c-e70b-4849-96d6-2368748011f9" acquired by "attach_volume" :: waited 0.039s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:04:49 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-38082b23-f01d-4a08-9b2e-a41dfa1e38df tempest-VolumesActionsTest-674359614 None] Attaching volume 748f170c-e70b-4849-96d6-2368748011f9 to instance 3bb30977-c2c2-49e4-a1b5-8a6277efc013 at mountpoint /dev/vdb on host None.
Sep 09 04:04:49 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-38082b23-f01d-4a08-9b2e-a41dfa1e38df tempest-VolumesActionsTest-674359614 None] Attach volume completed successfully.
Sep 09 04:04:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-38082b23-f01d-4a08-9b2e-a41dfa1e38df tempest-VolumesActionsTest-674359614 None] Lock "cinder-748f170c-e70b-4849-96d6-2368748011f9" released by "attach_volume" :: held 0.172s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:04:50 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-5c18bbcd-ac8f-4f8d-8072-a8fa47bcbb58 tempest-VolumesActionsTest-216359670 None] Terminate volume connection completed successfully.
Sep 09 04:04:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5c18bbcd-ac8f-4f8d-8072-a8fa47bcbb58 tempest-VolumesActionsTest-216359670 None] Acquiring lock "cinder-748f170c-e70b-4849-96d6-2368748011f9-detach_volume" by "detach_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:04:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5c18bbcd-ac8f-4f8d-8072-a8fa47bcbb58 tempest-VolumesActionsTest-216359670 None] Lock "cinder-748f170c-e70b-4849-96d6-2368748011f9-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:04:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-5c18bbcd-ac8f-4f8d-8072-a8fa47bcbb58 tempest-VolumesActionsTest-216359670 None] Detaching volume 748f170c-e70b-4849-96d6-2368748011f9 from instance 3bb30977-c2c2-49e4-a1b5-8a6277efc013.
Sep 09 04:04:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-5c18bbcd-ac8f-4f8d-8072-a8fa47bcbb58 tempest-VolumesActionsTest-216359670 None] Detach volume completed successfully.
Sep 09 04:04:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5c18bbcd-ac8f-4f8d-8072-a8fa47bcbb58 tempest-VolumesActionsTest-216359670 None] Lock "cinder-748f170c-e70b-4849-96d6-2368748011f9-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:04:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dd22bc91-dc3e-4548-a9ff-4030339a6f26 tempest-VolumesActionsTest-674359614 None] Acquiring lock "cinder-748f170c-e70b-4849-96d6-2368748011f9-detach_volume" by "detach_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:04:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dd22bc91-dc3e-4548-a9ff-4030339a6f26 tempest-VolumesActionsTest-674359614 None] Lock "cinder-748f170c-e70b-4849-96d6-2368748011f9-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:04:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-dd22bc91-dc3e-4548-a9ff-4030339a6f26 tempest-VolumesActionsTest-674359614 None] Volume detach called, but volume not attached.
Sep 09 04:04:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dd22bc91-dc3e-4548-a9ff-4030339a6f26 tempest-VolumesActionsTest-674359614 None] Lock "cinder-748f170c-e70b-4849-96d6-2368748011f9-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:04:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Acquiring lock "cinder-748f170c-e70b-4849-96d6-2368748011f9-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:04:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Lock "cinder-748f170c-e70b-4849-96d6-2368748011f9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:04:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Acquiring lock "cinder-quobyte-748f170c-e70b-4849-96d6-2368748011f9" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:04:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Lock "cinder-quobyte-748f170c-e70b-4849-96d6-2368748011f9" acquired by "delete_volume" :: waited 0.038s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:04:52 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacc4fae-665f-46fe-a838-39615fc598dd]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:04:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-748f170c-e70b-4849-96d6-2368748011f9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:52 devstack sudo[103143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-748f170c-e70b-4849-96d6-2368748011f9
Sep 09 04:04:52 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:52 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-748f170c-e70b-4849-96d6-2368748011f9" returned: 0 in 0.464s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-748f170c-e70b-4849-96d6-2368748011f9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:52 devstack sudo[103150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-748f170c-e70b-4849-96d6-2368748011f9
Sep 09 04:04:52 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:52 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-748f170c-e70b-4849-96d6-2368748011f9" returned: 0 in 0.441s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Lock "cinder-quobyte-748f170c-e70b-4849-96d6-2368748011f9" released by "delete_volume" :: held 0.988s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:04:53 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Created reservations ['f8ff6710-407b-4b07-947c-2a98d3c741ad', '942a2144-f7f7-4281-a6f7-65baf0dcfb97', '4d2068d6-7756-4ccf-9beb-866bc5bd9e0c', '86bdb3d8-a5e1-4381-b2bb-fdac2049277a'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:04:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:04:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:04:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:53 devstack sudo[103162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:04:53 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:53 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.496s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:53 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:04:53 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Deleted volume successfully.
Sep 09 04:04:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-77a0c50e-1c90-440a-a622-03fcb06d9da3 tempest-VolumesActionsTest-674359614 None] Lock "cinder-748f170c-e70b-4849-96d6-2368748011f9-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Flow 'volume_create_manager' (13ebeef0-e028-43fe-9096-494817b51bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef48f314-1479-4e52-92ba-367b1cbc90bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef48f314-1479-4e52-92ba-367b1cbc90bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235589352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8606762d-dd9d-41aa-9899-deb3797a6e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb8252f79864f2991562a6a6acd9609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:55Z,use_quota=True,user_id='a4e0b97e509b43bd95a01a618ee714fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c083f7-23d1-414b-ab2f-005b7e0fcf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c083f7-23d1-414b-ab2f-005b7e0fcf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912116b8-b66b-42c0-ade1-4dc6774d12ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912116b8-b66b-42c0-ade1-4dc6774d12ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8606762d-dd9d-41aa-9899-deb3797a6e56', 'volume_name': 'volume-8606762d-dd9d-41aa-9899-deb3797a6e56', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea921c9-fba8-4781-9237-8aba406c1219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea921c9-fba8-4781-9237-8aba406c1219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076f61c3-8484-4bc2-b95a-da1877f3983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:55 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Volume 8606762d-dd9d-41aa-9899-deb3797a6e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8606762d-dd9d-41aa-9899-deb3797a6e56', 'volume_size': 1}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235589352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8606762d-dd9d-41aa-9899-deb3797a6e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb8252f79864f2991562a6a6acd9609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:55Z,use_quota=True,user_id='a4e0b97e509b43bd95a01a618ee714fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Creating volume 8606762d-dd9d-41aa-9899-deb3797a6e56 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:04:55 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8606762d-dd9d-41aa-9899-deb3797a6e56 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:55 devstack sudo[103187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8606762d-dd9d-41aa-9899-deb3797a6e56 1073741824
Sep 09 04:04:55 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Flow 'volume_create_manager' (2abb88cd-74ae-44e4-8985-0fe78e7c71b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3587b69-91a2-4f97-83ad-002d5ed1c1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3587b69-91a2-4f97-83ad-002d5ed1c1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2041429681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ca27b0-6ef8-4b08-9815-656f23c24039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb8252f79864f2991562a6a6acd9609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:56Z,use_quota=True,user_id='a4e0b97e509b43bd95a01a618ee714fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c31e61-1e6a-4946-8123-157d38c31173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c31e61-1e6a-4946-8123-157d38c31173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4896bc4-6683-4e68-a251-15c5fe5742b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4896bc4-6683-4e68-a251-15c5fe5742b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90ca27b0-6ef8-4b08-9815-656f23c24039', 'volume_name': 'volume-90ca27b0-6ef8-4b08-9815-656f23c24039', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a6a353-f648-4190-9601-f9ee9b175e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a6a353-f648-4190-9601-f9ee9b175e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100eaaf9-953d-4870-9eb3-0534949b142a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:55 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Volume 90ca27b0-6ef8-4b08-9815-656f23c24039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90ca27b0-6ef8-4b08-9815-656f23c24039', 'volume_size': 1}
Sep 09 04:04:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:04:56 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Flow 'volume_create_manager' (f55e367f-e5a5-4e5c-a3e0-ee8eb67a2a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f2017a-46b6-4424-8697-32173017e79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8606762d-dd9d-41aa-9899-deb3797a6e56 1073741824" returned: 0 in 0.949s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f2017a-46b6-4424-8697-32173017e79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-914938348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53f7134-6fac-4897-8c6f-22c62d6eefc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb8252f79864f2991562a6a6acd9609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:56Z,use_quota=True,user_id='a4e0b97e509b43bd95a01a618ee714fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bf2beb-275b-4a5e-9465-2d0612d2ae0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bf2beb-275b-4a5e-9465-2d0612d2ae0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6610602d-3539-409d-ad7b-12c53dfb3407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6610602d-3539-409d-ad7b-12c53dfb3407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f53f7134-6fac-4897-8c6f-22c62d6eefc1', 'volume_name': 'volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae6b9fb-4710-4c7f-bf5e-2b6e0f2e23e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae6b9fb-4710-4c7f-bf5e-2b6e0f2e23e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ebc30d-c3d8-464e-b442-161ac2cf5ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:56 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Volume f53f7134-6fac-4897-8c6f-22c62d6eefc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1', 'volume_size': 1}
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8606762d-dd9d-41aa-9899-deb3797a6e56 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:56 devstack sudo[103206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8606762d-dd9d-41aa-9899-deb3797a6e56
Sep 09 04:04:56 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:04:57 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Flow 'volume_create_manager' (630f1a41-b08f-4ac4-b11b-b1df90ad8893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307b4e06-467e-41c8-b9a6-a63dc5d96db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8606762d-dd9d-41aa-9899-deb3797a6e56" returned: 0 in 0.451s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.255s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2041429681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ca27b0-6ef8-4b08-9815-656f23c24039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb8252f79864f2991562a6a6acd9609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:56Z,use_quota=True,user_id='a4e0b97e509b43bd95a01a618ee714fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Creating volume 90ca27b0-6ef8-4b08-9815-656f23c24039 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:04:57 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-90ca27b0-6ef8-4b08-9815-656f23c24039 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307b4e06-467e-41c8-b9a6-a63dc5d96db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1178767672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f918ed5-f7d3-4787-979e-36e43ef578ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb8252f79864f2991562a6a6acd9609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:57Z,use_quota=True,user_id='a4e0b97e509b43bd95a01a618ee714fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c009b96-caac-4a06-a927-e03bc8fbf236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:57 devstack sudo[103210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-90ca27b0-6ef8-4b08-9815-656f23c24039 1073741824
Sep 09 04:04:57 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c009b96-caac-4a06-a927-e03bc8fbf236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afffc8a-a542-48a9-942e-6a44ee970906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afffc8a-a542-48a9-942e-6a44ee970906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f918ed5-f7d3-4787-979e-36e43ef578ec', 'volume_name': 'volume-9f918ed5-f7d3-4787-979e-36e43ef578ec', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f37effa-3989-46e9-a51c-22aaef1dbea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f37effa-3989-46e9-a51c-22aaef1dbea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbe6733-5bce-477f-8796-e2592f322b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:57 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Volume 9f918ed5-f7d3-4787-979e-36e43ef578ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f918ed5-f7d3-4787-979e-36e43ef578ec', 'volume_size': 1}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076f61c3-8484-4bc2-b95a-da1877f3983e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8606762d-dd9d-41aa-9899-deb3797a6e56', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b7cbb0-9db0-4ad7-b346-e65021e858d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:57 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Volume volume-8606762d-dd9d-41aa-9899-deb3797a6e56 (8606762d-dd9d-41aa-9899-deb3797a6e56): created successfully
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b7cbb0-9db0-4ad7-b346-e65021e858d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Flow 'volume_create_manager' (13ebeef0-e028-43fe-9096-494817b51bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:57 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4d380a46-67f5-4151-882a-e2898786dc3a tempest-CreateVolumesFromImageTest-2137082931 None] Created volume successfully.
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Flow 'volume_create_manager' (bb172e2d-3491-475e-a0cd-e6c2b0dadb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fd2ea8-bb72-4a4d-8690-eb8769315056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fd2ea8-bb72-4a4d-8690-eb8769315056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050842519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243087d1-93ca-44e6-ba70-cf3429f4b88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb8252f79864f2991562a6a6acd9609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:58Z,use_quota=True,user_id='a4e0b97e509b43bd95a01a618ee714fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3586b95-0098-4461-9a6e-baa2b8987fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3586b95-0098-4461-9a6e-baa2b8987fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f99b06-290b-4a45-b0c9-2e253d8189d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f99b06-290b-4a45-b0c9-2e253d8189d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243087d1-93ca-44e6-ba70-cf3429f4b88d', 'volume_name': 'volume-243087d1-93ca-44e6-ba70-cf3429f4b88d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dd6a17-501d-4da0-83be-76667ee32c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dd6a17-501d-4da0-83be-76667ee32c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9fab966-876e-4797-b4e9-f128607a172d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:57 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Volume 243087d1-93ca-44e6-ba70-cf3429f4b88d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243087d1-93ca-44e6-ba70-cf3429f4b88d', 'volume_size': 1}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:57 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-90ca27b0-6ef8-4b08-9815-656f23c24039 1073741824" returned: 0 in 0.683s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-90ca27b0-6ef8-4b08-9815-656f23c24039 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:57 devstack sudo[103240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-90ca27b0-6ef8-4b08-9815-656f23c24039
Sep 09 04:04:57 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:58 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-90ca27b0-6ef8-4b08-9815-656f23c24039" returned: 0 in 0.244s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.499s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-914938348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53f7134-6fac-4897-8c6f-22c62d6eefc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb8252f79864f2991562a6a6acd9609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:56Z,use_quota=True,user_id='a4e0b97e509b43bd95a01a618ee714fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Creating volume f53f7134-6fac-4897-8c6f-22c62d6eefc1 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:04:58 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100eaaf9-953d-4870-9eb3-0534949b142a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ca27b0-6ef8-4b08-9815-656f23c24039', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c64a14b-e544-4990-9446-cf05f1cffc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:58 devstack sudo[103243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1 1073741824
Sep 09 04:04:58 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:58 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Volume volume-90ca27b0-6ef8-4b08-9815-656f23c24039 (90ca27b0-6ef8-4b08-9815-656f23c24039): created successfully
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c64a14b-e544-4990-9446-cf05f1cffc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Flow 'volume_create_manager' (2abb88cd-74ae-44e4-8985-0fe78e7c71b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:58 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9a6b8131-c9a9-4bf0-a574-dd90532cc366 tempest-CreateVolumesFromImageTest-2137082931 None] Created volume successfully.
Sep 09 04:04:58 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1 1073741824" returned: 0 in 0.411s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:58 devstack sudo[103249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1
Sep 09 04:04:58 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:58 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1" returned: 0 in 0.254s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1178767672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f918ed5-f7d3-4787-979e-36e43ef578ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb8252f79864f2991562a6a6acd9609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:57Z,use_quota=True,user_id='a4e0b97e509b43bd95a01a618ee714fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Creating volume 9f918ed5-f7d3-4787-979e-36e43ef578ec {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:04:58 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9f918ed5-f7d3-4787-979e-36e43ef578ec 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ebc30d-c3d8-464e-b442-161ac2cf5ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:58 devstack sudo[103252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9f918ed5-f7d3-4787-979e-36e43ef578ec 1073741824
Sep 09 04:04:58 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334472fe-2d56-48e3-83e2-47630d2c7837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:58 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Volume volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1 (f53f7134-6fac-4897-8c6f-22c62d6eefc1): created successfully
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334472fe-2d56-48e3-83e2-47630d2c7837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Flow 'volume_create_manager' (f55e367f-e5a5-4e5c-a3e0-ee8eb67a2a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:58 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c1f83044-5ee1-4f6e-a966-58a0bba0dbce tempest-CreateVolumesFromImageTest-2137082931 None] Created volume successfully.
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:04:59 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Flow 'volume_create_manager' (094d96c7-115e-4023-999c-215ebb2e3889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f01343-b668-4ff1-b064-706bb991b355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9f918ed5-f7d3-4787-979e-36e43ef578ec 1073741824" returned: 0 in 0.504s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f01343-b668-4ff1-b064-706bb991b355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1500601249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6692f3eb-67e7-4cf0-b828-dfb2949ed351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f35756dbc3946059ba54745973f9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:59Z,use_quota=True,user_id='402ad199137640c98d0b1afe3c38707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9109727-9b2b-46f7-8759-ed58349fd69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9109727-9b2b-46f7-8759-ed58349fd69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f868c841-097a-40ef-829a-b01831c2b2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f868c841-097a-40ef-829a-b01831c2b2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6692f3eb-67e7-4cf0-b828-dfb2949ed351', 'volume_name': 'volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb6f032-45b1-4a22-b436-0e06daa51334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb6f032-45b1-4a22-b436-0e06daa51334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2f4178-5a05-4746-b118-ad15caa36e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:59 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Volume 6692f3eb-67e7-4cf0-b828-dfb2949ed351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351', 'volume_size': 1}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9f918ed5-f7d3-4787-979e-36e43ef578ec {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:59 devstack sudo[103258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9f918ed5-f7d3-4787-979e-36e43ef578ec
Sep 09 04:04:59 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:59 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9f918ed5-f7d3-4787-979e-36e43ef578ec" returned: 0 in 0.240s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.878s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050842519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243087d1-93ca-44e6-ba70-cf3429f4b88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb8252f79864f2991562a6a6acd9609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:58Z,use_quota=True,user_id='a4e0b97e509b43bd95a01a618ee714fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Creating volume 243087d1-93ca-44e6-ba70-cf3429f4b88d {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:04:59 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-243087d1-93ca-44e6-ba70-cf3429f4b88d 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:04:59 devstack sudo[103261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-243087d1-93ca-44e6-ba70-cf3429f4b88d 1073741824
Sep 09 04:04:59 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbe6733-5bce-477f-8796-e2592f322b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f918ed5-f7d3-4787-979e-36e43ef578ec', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc0e470-9122-47c6-9907-36f990e32c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:04:59 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Volume volume-9f918ed5-f7d3-4787-979e-36e43ef578ec (9f918ed5-f7d3-4787-979e-36e43ef578ec): created successfully
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc0e470-9122-47c6-9907-36f990e32c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:04:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Flow 'volume_create_manager' (630f1a41-b08f-4ac4-b11b-b1df90ad8893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:04:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e0475cd9-82c6-45f3-9905-5b2bc5db7d07 tempest-CreateVolumesFromImageTest-2137082931 None] Created volume successfully.
Sep 09 04:05:00 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-243087d1-93ca-44e6-ba70-cf3429f4b88d 1073741824" returned: 0 in 0.397s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-243087d1-93ca-44e6-ba70-cf3429f4b88d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:00 devstack sudo[103266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-243087d1-93ca-44e6-ba70-cf3429f4b88d
Sep 09 04:05:00 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:00 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-243087d1-93ca-44e6-ba70-cf3429f4b88d" returned: 0 in 0.240s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1500601249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6692f3eb-67e7-4cf0-b828-dfb2949ed351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f35756dbc3946059ba54745973f9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:04:59Z,use_quota=True,user_id='402ad199137640c98d0b1afe3c38707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Creating volume 6692f3eb-67e7-4cf0-b828-dfb2949ed351 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:00 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9fab966-876e-4797-b4e9-f128607a172d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243087d1-93ca-44e6-ba70-cf3429f4b88d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:00 devstack sudo[103269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351 1073741824
Sep 09 04:05:00 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76e8b58-b418-429d-bbfb-1af349b82d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:00 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Volume volume-243087d1-93ca-44e6-ba70-cf3429f4b88d (243087d1-93ca-44e6-ba70-cf3429f4b88d): created successfully
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76e8b58-b418-429d-bbfb-1af349b82d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Flow 'volume_create_manager' (bb172e2d-3491-475e-a0cd-e6c2b0dadb90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:00 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-1cc76486-2b7d-4c87-8026-baafa37c8bc1 tempest-CreateVolumesFromImageTest-2137082931 None] Created volume successfully.
Sep 09 04:05:00 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351 1073741824" returned: 0 in 0.405s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:00 devstack sudo[103275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351
Sep 09 04:05:00 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:01 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351" returned: 0 in 0.248s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2f4178-5a05-4746-b118-ad15caa36e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6228e67e-81ac-42cc-bdec-0e0312ebd05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "cinder-243087d1-93ca-44e6-ba70-cf3429f4b88d-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:01 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Volume volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351 (6692f3eb-67e7-4cf0-b828-dfb2949ed351): created successfully
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6228e67e-81ac-42cc-bdec-0e0312ebd05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Flow 'volume_create_manager' (094d96c7-115e-4023-999c-215ebb2e3889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-243087d1-93ca-44e6-ba70-cf3429f4b88d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:01 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-62d48b81-0232-448d-b22c-2ee4e0f1884e tempest-VolumesActionsTest-674359614 None] Created volume successfully.
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "cinder-quobyte-243087d1-93ca-44e6-ba70-cf3429f4b88d" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-quobyte-243087d1-93ca-44e6-ba70-cf3429f4b88d" acquired by "delete_volume" :: waited 0.013s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a591aee-220f-4d59-91fe-e28956422961]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-243087d1-93ca-44e6-ba70-cf3429f4b88d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:01 devstack sudo[103281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-243087d1-93ca-44e6-ba70-cf3429f4b88d
Sep 09 04:05:01 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Acquiring lock "cinder-6692f3eb-67e7-4cf0-b828-dfb2949ed351-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Lock "cinder-6692f3eb-67e7-4cf0-b828-dfb2949ed351-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Acquiring lock "cinder-quobyte-6692f3eb-67e7-4cf0-b828-dfb2949ed351" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Lock "cinder-quobyte-6692f3eb-67e7-4cf0-b828-dfb2949ed351" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:01 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-243087d1-93ca-44e6-ba70-cf3429f4b88d" returned: 0 in 0.381s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-243087d1-93ca-44e6-ba70-cf3429f4b88d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89a3d71-a9cb-4656-a71c-9d9fbf14a57a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:01 devstack sudo[103287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-243087d1-93ca-44e6-ba70-cf3429f4b88d
Sep 09 04:05:01 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:01 devstack sudo[103288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351
Sep 09 04:05:01 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:01 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-243087d1-93ca-44e6-ba70-cf3429f4b88d" returned: 0 in 0.242s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-quobyte-243087d1-93ca-44e6-ba70-cf3429f4b88d" released by "delete_volume" :: held 0.664s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Created reservations ['f4a0f9f6-2448-444b-8d74-012a291d2b99', '2f6ad8a7-42f7-4070-b884-ce2eb374dc4a', 'a738f95c-6486-4731-8565-5b50f12a96d0', '3b823303-0dfb-4839-b8fa-79255eada0d3'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:01 devstack sudo[103295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:01 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:01 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351" returned: 0 in 0.404s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:01 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351
Sep 09 04:05:01 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:02 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.253s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:02 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Deleted volume successfully.
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-473aff07-4cb0-41f5-84e2-b98bc2183863 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-243087d1-93ca-44e6-ba70-cf3429f4b88d-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:02 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6692f3eb-67e7-4cf0-b828-dfb2949ed351" returned: 0 in 0.261s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Lock "cinder-quobyte-6692f3eb-67e7-4cf0-b828-dfb2949ed351" released by "delete_volume" :: held 0.708s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "cinder-9f918ed5-f7d3-4787-979e-36e43ef578ec-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-9f918ed5-f7d3-4787-979e-36e43ef578ec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "cinder-quobyte-9f918ed5-f7d3-4787-979e-36e43ef578ec" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Created reservations ['738767f5-595f-436c-8924-dcb0c161f181', 'c8e6c9a6-522c-44cb-8ff4-331cc02a0ab7', 'd27fb337-8603-4a6e-93e9-f29f07131dc5', '347a1b4c-2f91-41a6-96e4-319b6a7c1ead'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-quobyte-9f918ed5-f7d3-4787-979e-36e43ef578ec" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[344d6ab6-5d7b-43d0-92af-8d3eea21dea4]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9f918ed5-f7d3-4787-979e-36e43ef578ec {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:02 devstack sudo[103302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:02 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:02 devstack sudo[103301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9f918ed5-f7d3-4787-979e-36e43ef578ec
Sep 09 04:05:02 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:02 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.261s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:02 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Deleted volume successfully.
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-be9a1832-8af9-4663-9b8f-77c71b565ed2 tempest-VolumesActionsTest-216359670 None] Lock "cinder-6692f3eb-67e7-4cf0-b828-dfb2949ed351-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:02 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9f918ed5-f7d3-4787-979e-36e43ef578ec" returned: 0 in 0.396s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9f918ed5-f7d3-4787-979e-36e43ef578ec {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:02 devstack sudo[103309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9f918ed5-f7d3-4787-979e-36e43ef578ec
Sep 09 04:05:02 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:03 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-9f918ed5-f7d3-4787-979e-36e43ef578ec" returned: 0 in 0.266s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-quobyte-9f918ed5-f7d3-4787-979e-36e43ef578ec" released by "delete_volume" :: held 0.708s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Created reservations ['d6433358-5335-495b-a030-b180ff6d745a', '2cddc5ba-90f1-4172-a02b-bc69dd6d30ae', 'cf90d4d7-d46c-46cd-88ff-136173f73de8', 'ddb480d3-aedc-42de-bd71-1f40933ad7eb'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:03 devstack sudo[103312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:03 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Flow 'volume_create_manager' (56951994-e689-4840-8b8b-ce242c83fdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07af184-bcce-45e0-8d25-239a0c308bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07af184-bcce-45e0-8d25-239a0c308bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-606618202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67bd95cc-d1ba-415d-928c-5e132f6d2c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f35756dbc3946059ba54745973f9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:03Z,use_quota=True,user_id='402ad199137640c98d0b1afe3c38707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d23ec74-3e39-4258-bdff-5e740e028828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d23ec74-3e39-4258-bdff-5e740e028828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4bce5-ddab-4c79-b70e-aeeac0ce2d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4bce5-ddab-4c79-b70e-aeeac0ce2d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67bd95cc-d1ba-415d-928c-5e132f6d2c5c', 'volume_name': 'volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d3b693-a4f0-4769-8794-87cebe6f18bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d3b693-a4f0-4769-8794-87cebe6f18bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a4fce5-9e8d-4afd-ba8d-4c73c5eefae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:03 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Volume 67bd95cc-d1ba-415d-928c-5e132f6d2c5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c', 'volume_size': 1}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-606618202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67bd95cc-d1ba-415d-928c-5e132f6d2c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f35756dbc3946059ba54745973f9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:03Z,use_quota=True,user_id='402ad199137640c98d0b1afe3c38707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Creating volume 67bd95cc-d1ba-415d-928c-5e132f6d2c5c {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:03 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:03 devstack sudo[103314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c 1073741824
Sep 09 04:05:03 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "cinder-f53f7134-6fac-4897-8c6f-22c62d6eefc1-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:03 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.262s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-f53f7134-6fac-4897-8c6f-22c62d6eefc1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:03 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Deleted volume successfully.
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fe60f7cd-4fe2-472b-9bea-cc926ee083aa tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-9f918ed5-f7d3-4787-979e-36e43ef578ec-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "cinder-quobyte-f53f7134-6fac-4897-8c6f-22c62d6eefc1" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-quobyte-f53f7134-6fac-4897-8c6f-22c62d6eefc1" acquired by "delete_volume" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a29b617-f795-4c4d-a2a5-f18ecd6e5f5c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:03 devstack sudo[103319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1
Sep 09 04:05:03 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:03 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c 1073741824" returned: 0 in 0.477s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:03 devstack sudo[103323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c
Sep 09 04:05:03 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:03 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1" returned: 0 in 0.396s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:03 devstack sudo[103328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1
Sep 09 04:05:03 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:04 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c" returned: 0 in 0.284s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a4fce5-9e8d-4afd-ba8d-4c73c5eefae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c8241b-77ad-4d9a-802f-9154167df5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:04 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Volume volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c (67bd95cc-d1ba-415d-928c-5e132f6d2c5c): created successfully
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c8241b-77ad-4d9a-802f-9154167df5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Flow 'volume_create_manager' (56951994-e689-4840-8b8b-ce242c83fdfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:04 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f830b6fb-e241-4bf2-8c72-74ed1bfe5744 tempest-VolumesActionsTest-674359614 None] Created volume successfully.
Sep 09 04:05:04 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f53f7134-6fac-4897-8c6f-22c62d6eefc1" returned: 0 in 0.257s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-quobyte-f53f7134-6fac-4897-8c6f-22c62d6eefc1" released by "delete_volume" :: held 0.691s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Created reservations ['c1c542d9-39c5-4e5c-97ff-90329837c07d', '250edd2a-6bc4-437d-89e7-45f7c43acc58', 'e00eedb5-6f84-48d3-947d-ab6d934aee1b', '4fc4d1d0-8d85-49e0-b4b5-b381e731fba1'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:04 devstack sudo[103332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:04 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:04 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.255s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:04 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Deleted volume successfully.
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "cinder-90ca27b0-6ef8-4b08-9815-656f23c24039-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-90ca27b0-6ef8-4b08-9815-656f23c24039-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eb3acca4-38c3-478a-91b3-c5be1710229d tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-f53f7134-6fac-4897-8c6f-22c62d6eefc1-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "cinder-quobyte-90ca27b0-6ef8-4b08-9815-656f23c24039" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-quobyte-90ca27b0-6ef8-4b08-9815-656f23c24039" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[23db074d-b246-462b-adea-4febe7e66a14]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-90ca27b0-6ef8-4b08-9815-656f23c24039 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:04 devstack sudo[103335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-90ca27b0-6ef8-4b08-9815-656f23c24039
Sep 09 04:05:04 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:05 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-90ca27b0-6ef8-4b08-9815-656f23c24039" returned: 0 in 0.401s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-90ca27b0-6ef8-4b08-9815-656f23c24039 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:05 devstack sudo[103340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-90ca27b0-6ef8-4b08-9815-656f23c24039
Sep 09 04:05:05 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:05 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-90ca27b0-6ef8-4b08-9815-656f23c24039" returned: 0 in 0.281s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Acquiring lock "cinder-67bd95cc-d1ba-415d-928c-5e132f6d2c5c-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-quobyte-90ca27b0-6ef8-4b08-9815-656f23c24039" released by "delete_volume" :: held 0.737s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Lock "cinder-67bd95cc-d1ba-415d-928c-5e132f6d2c5c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Acquiring lock "cinder-quobyte-67bd95cc-d1ba-415d-928c-5e132f6d2c5c" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Created reservations ['a0968632-bf4a-40d4-a126-df9b4a147491', 'f66da701-21d7-42bf-b06a-fa8c6975b0ac', 'ab0cfb23-fcd5-494e-9334-8d25daf8090c', '15f9b8fb-3fc1-4200-b562-ad4cfd72fbac'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Lock "cinder-quobyte-67bd95cc-d1ba-415d-928c-5e132f6d2c5c" acquired by "delete_volume" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[2125af78-18b2-4721-b38c-7480ca0b610c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:05 devstack sudo[103345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:05 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:05 devstack sudo[103344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c
Sep 09 04:05:05 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "cinder-8606762d-dd9d-41aa-9899-deb3797a6e56-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-8606762d-dd9d-41aa-9899-deb3797a6e56-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "cinder-quobyte-8606762d-dd9d-41aa-9899-deb3797a6e56" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:05 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.314s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-quobyte-8606762d-dd9d-41aa-9899-deb3797a6e56" acquired by "delete_volume" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:05 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Deleted volume successfully.
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[035d8ed8-ec30-4648-a9e9-576ef66cc57e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8606762d-dd9d-41aa-9899-deb3797a6e56 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:05 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c" returned: 0 in 0.452s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e8bc32fa-4d44-4ca6-b17e-cd23322d4392 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-90ca27b0-6ef8-4b08-9815-656f23c24039-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:06 devstack sudo[103353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c
Sep 09 04:05:06 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:06 devstack sudo[103352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8606762d-dd9d-41aa-9899-deb3797a6e56
Sep 09 04:05:06 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:06 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-67bd95cc-d1ba-415d-928c-5e132f6d2c5c" returned: 0 in 0.277s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Lock "cinder-quobyte-67bd95cc-d1ba-415d-928c-5e132f6d2c5c" released by "delete_volume" :: held 0.773s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Created reservations ['1a885b65-c27e-4cff-8825-78b0691fe314', '1ed6252a-f03c-46ab-8900-d8685e6ec3ec', '9a5a33a5-b7a5-48e2-8599-68664a3bdb1b', '64664c72-ba2f-49a9-81cc-550f2e40680d'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:06 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8606762d-dd9d-41aa-9899-deb3797a6e56" returned: 0 in 0.383s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8606762d-dd9d-41aa-9899-deb3797a6e56 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:06 devstack sudo[103360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8606762d-dd9d-41aa-9899-deb3797a6e56
Sep 09 04:05:06 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:06 devstack sudo[103362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:06 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:06 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-8606762d-dd9d-41aa-9899-deb3797a6e56" returned: 0 in 0.250s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-quobyte-8606762d-dd9d-41aa-9899-deb3797a6e56" released by "delete_volume" :: held 0.689s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:06 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.252s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:06 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Deleted volume successfully.
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Created reservations ['d2761119-783d-409e-bfc3-8ecf5b0046ce', 'aa18ee1d-a085-423c-89b7-d1ef8efbac78', '2f3d6330-91be-4ac7-bf06-5b5721abe253', 'a1efc7bb-7862-4581-b43c-e2adb85786bb'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3291a5af-c3c0-4c9b-907f-8751638c0c27 tempest-VolumesActionsTest-216359670 None] Lock "cinder-67bd95cc-d1ba-415d-928c-5e132f6d2c5c-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:06 devstack sudo[103366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:06 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:07 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.274s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:07 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Deleted volume successfully.
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Flow 'volume_create_manager' (3e14cd61-b668-4d32-97e0-b0d822460b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47496ce4-d8eb-42c6-bcba-07fbc69373f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47496ce4-d8eb-42c6-bcba-07fbc69373f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1393880475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f35756dbc3946059ba54745973f9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:07Z,use_quota=True,user_id='402ad199137640c98d0b1afe3c38707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06742aa1-d365-40f6-bf33-5339c846d4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06742aa1-d365-40f6-bf33-5339c846d4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2f95cb-ff83-49ee-abd2-fd17ee0def54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2f95cb-ff83-49ee-abd2-fd17ee0def54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6', 'volume_name': 'volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6ae51c-1683-4581-a958-8dd223b88393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6ae51c-1683-4581-a958-8dd223b88393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11160c9f-727d-46ab-b718-afd7dd05d43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:07 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Volume 2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6', 'volume_size': 1}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1393880475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f35756dbc3946059ba54745973f9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:07Z,use_quota=True,user_id='402ad199137640c98d0b1afe3c38707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Creating volume 2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:07 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6f82c252-a0d9-497f-bebd-5f882b817bf4 tempest-CreateVolumesFromImageTest-2137082931 None] Lock "cinder-8606762d-dd9d-41aa-9899-deb3797a6e56-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:07 devstack sudo[103369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6 1073741824
Sep 09 04:05:07 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:07 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6 1073741824" returned: 0 in 0.479s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:07 devstack sudo[103375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6
Sep 09 04:05:07 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:07 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6" returned: 0 in 0.274s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11160c9f-727d-46ab-b718-afd7dd05d43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54b348c-7722-43e7-b7ac-85eed9ab9924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:08 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Volume volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6 (2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6): created successfully
Sep 09 04:05:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54b348c-7722-43e7-b7ac-85eed9ab9924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Flow 'volume_create_manager' (3e14cd61-b668-4d32-97e0-b0d822460b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:08 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-360f7638-90f6-41e6-adf4-6746ec45c039 tempest-VolumesActionsTest-674359614 None] Created volume successfully.
Sep 09 04:05:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Acquiring lock "cinder-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Lock "cinder-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Acquiring lock "cinder-quobyte-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Lock "cinder-quobyte-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:09 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[66296971-e123-49cd-b2d0-6fe16675b30a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:09 devstack sudo[103414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6
Sep 09 04:05:09 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:09 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6" returned: 0 in 0.431s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:09 devstack sudo[103419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6
Sep 09 04:05:09 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:09 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Flow 'volume_create_manager' (c7e66b98-0c36-4ca4-beab-e40e38c0cdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a473459-9f3f-485e-84af-9ff21b0ec0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a473459-9f3f-485e-84af-9ff21b0ec0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-963042622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72288f96872445eb6ca52a6d9eef62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:10Z,use_quota=True,user_id='145432d829b3454a87aafff730ba9b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4b530d-ac1a-49ec-a6fe-2e84204f34e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4b530d-ac1a-49ec-a6fe-2e84204f34e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a015dbc4-1b50-494d-9403-85942c22846b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a015dbc4-1b50-494d-9403-85942c22846b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413', 'volume_name': 'volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efca16f8-58c4-493b-8b4d-b9f118003c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efca16f8-58c4-493b-8b4d-b9f118003c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd50353-464d-46e1-b540-250f6ce93957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:10 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413', 'volume_size': 1}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-963042622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72288f96872445eb6ca52a6d9eef62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:10Z,use_quota=True,user_id='145432d829b3454a87aafff730ba9b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Creating volume d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:10 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:10 devstack sudo[103421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 1073741824
Sep 09 04:05:10 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:10 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6" returned: 0 in 0.267s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Lock "cinder-quobyte-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6" released by "delete_volume" :: held 0.743s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Created reservations ['87134d80-95b8-42d2-af88-8476589f2739', 'f51abcbd-e925-4d15-84cb-8900bd1fb8ed', '82c4b025-71bb-4cb2-8ee6-b685b329e34e', '6a6000fb-729f-48bb-8e6d-066671d09e39'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:10 devstack sudo[103424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:10 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:10 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 1073741824" returned: 0 in 0.468s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:10 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.279s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:10 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Deleted volume successfully.
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-da967cd1-04df-432b-8afe-82fd39c91ec0 tempest-VolumesActionsTest-216359670 None] Lock "cinder-2c5b2360-82b4-4845-b6b7-ccc8f9dbeff6-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:10 devstack sudo[103432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413
Sep 09 04:05:10 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:10 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413" returned: 0 in 0.264s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd50353-464d-46e1-b540-250f6ce93957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59efb947-e558-44d6-a840-3c1a02371c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:10 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 (d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413): created successfully
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59efb947-e558-44d6-a840-3c1a02371c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Flow 'volume_create_manager' (c7e66b98-0c36-4ca4-beab-e40e38c0cdcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:10 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8a8003f9-a06e-455c-9529-584b078c85c5 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Created volume successfully.
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Flow 'volume_create_manager' (ca43bdbc-ed13-4c30-b82d-77ede4ae51cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ff5584-040f-4e30-9ddf-eea7f83e1db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ff5584-040f-4e30-9ddf-eea7f83e1db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-700996086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b01d37f-1a01-4d67-bab0-be3669b82c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f35756dbc3946059ba54745973f9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:11Z,use_quota=True,user_id='402ad199137640c98d0b1afe3c38707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8086c818-23b4-4bcf-a374-f0ec4f5297d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8086c818-23b4-4bcf-a374-f0ec4f5297d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0826505c-9def-406b-99e3-083e1557d0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0826505c-9def-406b-99e3-083e1557d0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b01d37f-1a01-4d67-bab0-be3669b82c60', 'volume_name': 'volume-3b01d37f-1a01-4d67-bab0-be3669b82c60', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e15035bc-bda5-43f4-9d46-ea756b121ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e15035bc-bda5-43f4-9d46-ea756b121ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abf02fa-75c2-405e-8761-b759523a7f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:11 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Volume 3b01d37f-1a01-4d67-bab0-be3669b82c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b01d37f-1a01-4d67-bab0-be3669b82c60', 'volume_size': 1}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-700996086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b01d37f-1a01-4d67-bab0-be3669b82c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f35756dbc3946059ba54745973f9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:11Z,use_quota=True,user_id='402ad199137640c98d0b1afe3c38707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Creating volume 3b01d37f-1a01-4d67-bab0-be3669b82c60 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:11 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3b01d37f-1a01-4d67-bab0-be3669b82c60 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:11 devstack sudo[103435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3b01d37f-1a01-4d67-bab0-be3669b82c60 1073741824
Sep 09 04:05:11 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:11 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3b01d37f-1a01-4d67-bab0-be3669b82c60 1073741824" returned: 0 in 0.397s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3b01d37f-1a01-4d67-bab0-be3669b82c60 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:11 devstack sudo[103440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3b01d37f-1a01-4d67-bab0-be3669b82c60
Sep 09 04:05:11 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:11 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3b01d37f-1a01-4d67-bab0-be3669b82c60" returned: 0 in 0.246s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abf02fa-75c2-405e-8761-b759523a7f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b01d37f-1a01-4d67-bab0-be3669b82c60', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722f6f63-0bde-46f0-b2de-726f9db847a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:11 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Volume volume-3b01d37f-1a01-4d67-bab0-be3669b82c60 (3b01d37f-1a01-4d67-bab0-be3669b82c60): created successfully
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722f6f63-0bde-46f0-b2de-726f9db847a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Flow 'volume_create_manager' (ca43bdbc-ed13-4c30-b82d-77ede4ae51cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:11 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-13e945bc-2e36-4a61-9930-b96ef5160afb tempest-VolumesActionsTest-674359614 None] Created volume successfully.
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Acquiring lock "cinder-3b01d37f-1a01-4d67-bab0-be3669b82c60-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Lock "cinder-3b01d37f-1a01-4d67-bab0-be3669b82c60-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Acquiring lock "cinder-quobyte-3b01d37f-1a01-4d67-bab0-be3669b82c60" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] Creating offline snapshot 34e38054-d2f8-4dc5-982d-5c472da93a3e of volume d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Lock "cinder-quobyte-3b01d37f-1a01-4d67-bab0-be3669b82c60" acquired by "delete_volume" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bd1582-2974-4798-a749-c32274ce7c94]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f51e1-0ae7-4b29-a161-74af42051b62]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3b01d37f-1a01-4d67-bab0-be3669b82c60 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:12 devstack sudo[103443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413
Sep 09 04:05:12 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:12 devstack sudo[103444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3b01d37f-1a01-4d67-bab0-be3669b82c60
Sep 09 04:05:12 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:12 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:12 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413" returned: 0 in 0.369s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3b01d37f-1a01-4d67-bab0-be3669b82c60" returned: 0 in 0.368s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3b01d37f-1a01-4d67-bab0-be3669b82c60 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:12 devstack sudo[103454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e 1G
Sep 09 04:05:12 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:12 devstack sudo[103455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3b01d37f-1a01-4d67-bab0-be3669b82c60
Sep 09 04:05:12 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:12 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3b01d37f-1a01-4d67-bab0-be3669b82c60" returned: 0 in 0.254s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Lock "cinder-quobyte-3b01d37f-1a01-4d67-bab0-be3669b82c60" released by "delete_volume" :: held 0.661s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:12 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Created reservations ['f9adfb78-fdd4-4650-9d6f-f950b5c84f13', 'd0cbeca2-543d-4990-a3e8-1c05de80e314', '3df414c6-8d74-4d91-abc0-87cc8a371498', 'eea8df56-73ce-4dd5-b5be-61b004fd7eee'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:13 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e 1G" returned: 0 in 0.411s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:13 devstack sudo[103463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:13 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:13 devstack sudo[103464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e
Sep 09 04:05:13 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:13 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.286s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:13 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Deleted volume successfully.
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a3f0d9ec-751c-43ac-9cda-b6352135f1fb tempest-VolumesActionsTest-216359670 None] Lock "cinder-3b01d37f-1a01-4d67-bab0-be3669b82c60-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:13 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e" returned: 0 in 0.318s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:13 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e is being set with open permissions: ugo+rw
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:13 devstack sudo[103471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e
Sep 09 04:05:13 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:13 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e" returned: 0 in 0.253s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:13 devstack sudo[103474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.info
Sep 09 04:05:13 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Flow 'volume_create_manager' (60161694-ff91-46a0-bb6c-378ea11fe3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea85e2d1-83b2-4a83-aba2-bcabd30b5c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea85e2d1-83b2-4a83-aba2-bcabd30b5c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-3078120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32075ffc-92ee-403d-a545-bf832498ff11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f35756dbc3946059ba54745973f9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:14Z,use_quota=True,user_id='402ad199137640c98d0b1afe3c38707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32243197-6928-4137-ba87-cd8f1ae7045c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32243197-6928-4137-ba87-cd8f1ae7045c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d150b0-fa10-4b29-a4dc-32378c236ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d150b0-fa10-4b29-a4dc-32378c236ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32075ffc-92ee-403d-a545-bf832498ff11', 'volume_name': 'volume-32075ffc-92ee-403d-a545-bf832498ff11', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67934ad1-04c2-47fa-b253-fd55bf73b14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67934ad1-04c2-47fa-b253-fd55bf73b14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:13 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8e4d4c-25d4-410c-9262-897cb564e30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:13 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Volume 32075ffc-92ee-403d-a545-bf832498ff11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32075ffc-92ee-403d-a545-bf832498ff11', 'volume_size': 1}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.info" returned: 0 in 0.270s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:13 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.info is being set with open permissions: ugo+rw
Sep 09 04:05:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:13 devstack sudo[103477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.info
Sep 09 04:05:13 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:14 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.info" returned: 0 in 0.254s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.276s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-3078120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32075ffc-92ee-403d-a545-bf832498ff11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f35756dbc3946059ba54745973f9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:14Z,use_quota=True,user_id='402ad199137640c98d0b1afe3c38707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Creating volume 32075ffc-92ee-403d-a545-bf832498ff11 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:14 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32075ffc-92ee-403d-a545-bf832498ff11 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:14 devstack sudo[103480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32075ffc-92ee-403d-a545-bf832498ff11 1073741824
Sep 09 04:05:14 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:14 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e0d89a71-3532-421c-a99c-fd93cabd32ca tempest-CreateVolumesFromSnapshotTest-1889642837 None] Create snapshot completed successfully
Sep 09 04:05:14 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32075ffc-92ee-403d-a545-bf832498ff11 1073741824" returned: 0 in 0.400s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32075ffc-92ee-403d-a545-bf832498ff11 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:14 devstack sudo[103486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32075ffc-92ee-403d-a545-bf832498ff11
Sep 09 04:05:14 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:14 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32075ffc-92ee-403d-a545-bf832498ff11" returned: 0 in 0.259s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8e4d4c-25d4-410c-9262-897cb564e30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32075ffc-92ee-403d-a545-bf832498ff11', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c2b7d5-6466-4216-af69-6565022fcd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:14 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Volume volume-32075ffc-92ee-403d-a545-bf832498ff11 (32075ffc-92ee-403d-a545-bf832498ff11): created successfully
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c2b7d5-6466-4216-af69-6565022fcd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Flow 'volume_create_manager' (60161694-ff91-46a0-bb6c-378ea11fe3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:14 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-026f4cb1-ad60-4bbd-ac0f-d1780f50fd55 tempest-VolumesActionsTest-674359614 None] Created volume successfully.
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Flow 'volume_create_manager' (0e8eb195-6269-447a-ba96-43ede905f341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411017af-66b8-4030-ad2f-b0cfbbce65b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411017af-66b8-4030-ad2f-b0cfbbce65b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-62903225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b947772-5bf5-48d2-8bcf-c2ee1cd88461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72288f96872445eb6ca52a6d9eef62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:16Z,use_quota=True,user_id='145432d829b3454a87aafff730ba9b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d86869e-c665-43bd-919c-c891d2a8561c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d86869e-c665-43bd-919c-c891d2a8561c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14eb38e9-b7fd-4e08-b0aa-b9674fae22af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14eb38e9-b7fd-4e08-b0aa-b9674fae22af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b947772-5bf5-48d2-8bcf-c2ee1cd88461', 'volume_name': 'volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66ea8dc-29cf-4a52-8d4b-8788f494355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66ea8dc-29cf-4a52-8d4b-8788f494355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4d921c-f7a3-44dc-83eb-311afe3f8a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:15 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume 5b947772-5bf5-48d2-8bcf-c2ee1cd88461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461', 'volume_size': 1}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-62903225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b947772-5bf5-48d2-8bcf-c2ee1cd88461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72288f96872445eb6ca52a6d9eef62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:16Z,use_quota=True,user_id='145432d829b3454a87aafff730ba9b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Creating volume 5b947772-5bf5-48d2-8bcf-c2ee1cd88461 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:15 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:15 devstack sudo[103490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461 1073741824
Sep 09 04:05:15 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Flow 'volume_create_manager' (a7f6f621-5539-42e3-b412-eb1036764a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911c1baa-cbb2-4783-a9d6-6d0d1faa5db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911c1baa-cbb2-4783-a9d6-6d0d1faa5db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1957794229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65049b4f-5e19-45ed-82a2-2145c7ec0e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72288f96872445eb6ca52a6d9eef62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:16Z,use_quota=True,user_id='145432d829b3454a87aafff730ba9b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bbb452-0e72-4f43-83e3-b8fc0bd40dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bbb452-0e72-4f43-83e3-b8fc0bd40dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6746ebd5-e694-4203-9eb3-d45e63e09539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6746ebd5-e694-4203-9eb3-d45e63e09539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65049b4f-5e19-45ed-82a2-2145c7ec0e96', 'volume_name': 'volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb8f0b7-6567-49c7-86cf-ee61887adb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb8f0b7-6567-49c7-86cf-ee61887adb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6af0a5-9457-4e7d-ba8f-816864100c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:16 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume 65049b4f-5e19-45ed-82a2-2145c7ec0e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96', 'volume_size': 1}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:16 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461 1073741824" returned: 0 in 0.568s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:16 devstack sudo[103496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461
Sep 09 04:05:16 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Acquiring lock "cinder-32075ffc-92ee-403d-a545-bf832498ff11-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Lock "cinder-32075ffc-92ee-403d-a545-bf832498ff11-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:16 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461" returned: 0 in 0.290s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1957794229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65049b4f-5e19-45ed-82a2-2145c7ec0e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72288f96872445eb6ca52a6d9eef62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:16Z,use_quota=True,user_id='145432d829b3454a87aafff730ba9b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Creating volume 65049b4f-5e19-45ed-82a2-2145c7ec0e96 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:16 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:16 devstack sudo[103499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96 1073741824
Sep 09 04:05:16 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Flow 'volume_create_manager' (bafaae8a-d48a-4a77-bd2e-d207e3e6391c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0118d9-86ac-4889-9c9d-dc903de6d136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4d921c-f7a3-44dc-83eb-311afe3f8a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cdfe20e-94f3-462b-86ed-b88dff272f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Acquiring lock "cinder-quobyte-32075ffc-92ee-403d-a545-bf832498ff11" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:17 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461 (5b947772-5bf5-48d2-8bcf-c2ee1cd88461): created successfully
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cdfe20e-94f3-462b-86ed-b88dff272f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Flow 'volume_create_manager' (0e8eb195-6269-447a-ba96-43ede905f341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0118d9-86ac-4889-9c9d-dc903de6d136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-844714636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32228240-4a02-4378-aab5-073a59f32edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72288f96872445eb6ca52a6d9eef62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:17Z,use_quota=True,user_id='145432d829b3454a87aafff730ba9b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca74f40-6f24-4d75-abcc-ff0687824afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca74f40-6f24-4d75-abcc-ff0687824afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f605952-5ae3-429e-89dc-ee641bf95f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f605952-5ae3-429e-89dc-ee641bf95f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32228240-4a02-4378-aab5-073a59f32edb', 'volume_name': 'volume-32228240-4a02-4378-aab5-073a59f32edb', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dda5a1-eaa5-4ca3-b917-0008cb1a7330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dda5a1-eaa5-4ca3-b917-0008cb1a7330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef9d41c-1cf2-40ff-ad37-e246b0854b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume 32228240-4a02-4378-aab5-073a59f32edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32228240-4a02-4378-aab5-073a59f32edb', 'volume_size': 1}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Lock "cinder-quobyte-32075ffc-92ee-403d-a545-bf832498ff11" acquired by "delete_volume" :: waited 0.132s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:17 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-42ed3557-e495-4a06-aedd-8fa86803fda4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Created volume successfully.
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[683ebacb-101d-420b-a15f-29983cba2ad5]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32075ffc-92ee-403d-a545-bf832498ff11 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Flow 'volume_create_manager' (9313d0af-5102-4304-a7a4-5e5d72e1a65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529abc51-4040-4abd-8bb7-1b377f7472e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529abc51-4040-4abd-8bb7-1b377f7472e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-892730563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258c4e4a-aeae-4b75-835a-1ee2fba20933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72288f96872445eb6ca52a6d9eef62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:17Z,use_quota=True,user_id='145432d829b3454a87aafff730ba9b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad85694-c153-4fca-9e09-d4101fc75dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad85694-c153-4fca-9e09-d4101fc75dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec4a1a4-249c-4f17-9c6b-67bbf2f90b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec4a1a4-249c-4f17-9c6b-67bbf2f90b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '258c4e4a-aeae-4b75-835a-1ee2fba20933', 'volume_name': 'volume-258c4e4a-aeae-4b75-835a-1ee2fba20933', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ea2320-4613-47cf-82ae-484afddae3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ea2320-4613-47cf-82ae-484afddae3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9246a4b-e527-4807-b448-8eed5e5129f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume 258c4e4a-aeae-4b75-835a-1ee2fba20933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-258c4e4a-aeae-4b75-835a-1ee2fba20933', 'volume_size': 1}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:17 devstack sudo[103508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32075ffc-92ee-403d-a545-bf832498ff11
Sep 09 04:05:17 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:17 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96 1073741824" returned: 0 in 0.630s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:17 devstack sudo[103512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96
Sep 09 04:05:17 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Flow 'volume_create_manager' (66f1bfa5-bfea-4e58-8be1-b4787a136ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e7082a-aca1-47d5-82fa-4c15e1feacfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e7082a-aca1-47d5-82fa-4c15e1feacfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1586042843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d86ec7-bd24-4ad8-8d5d-353bf40a3e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72288f96872445eb6ca52a6d9eef62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:18Z,use_quota=True,user_id='145432d829b3454a87aafff730ba9b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50d3407-af88-4804-824c-598aad42acd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50d3407-af88-4804-824c-598aad42acd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca394cdd-a960-4e39-9a9f-61290e6f65d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca394cdd-a960-4e39-9a9f-61290e6f65d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d86ec7-bd24-4ad8-8d5d-353bf40a3e72', 'volume_name': 'volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559baaca-7be3-4cbe-b0d5-11b4dc5f2287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559baaca-7be3-4cbe-b0d5-11b4dc5f2287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165bb871-ca15-47a0-be00-8a176692f649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume 65d86ec7-bd24-4ad8-8d5d-353bf40a3e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72', 'volume_size': 1}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32075ffc-92ee-403d-a545-bf832498ff11" returned: 0 in 0.531s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32075ffc-92ee-403d-a545-bf832498ff11 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:17 devstack sudo[103517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32075ffc-92ee-403d-a545-bf832498ff11
Sep 09 04:05:17 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:17 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96" returned: 0 in 0.311s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-844714636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32228240-4a02-4378-aab5-073a59f32edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72288f96872445eb6ca52a6d9eef62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:17Z,use_quota=True,user_id='145432d829b3454a87aafff730ba9b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Creating volume 32228240-4a02-4378-aab5-073a59f32edb {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:17 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32228240-4a02-4378-aab5-073a59f32edb 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6af0a5-9457-4e7d-ba8f-816864100c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack sudo[103520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32228240-4a02-4378-aab5-073a59f32edb 1073741824
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bb522a-b413-474c-9612-dc4597918dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:17 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:17 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96 (65049b4f-5e19-45ed-82a2-2145c7ec0e96): created successfully
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bb522a-b413-474c-9612-dc4597918dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Flow 'volume_create_manager' (a7f6f621-5539-42e3-b412-eb1036764a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:18 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2bc6faf9-0e2e-4e29-9ff2-15f2a310d330 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Created volume successfully.
Sep 09 04:05:18 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32075ffc-92ee-403d-a545-bf832498ff11" returned: 0 in 0.325s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Lock "cinder-quobyte-32075ffc-92ee-403d-a545-bf832498ff11" released by "delete_volume" :: held 0.909s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Created reservations ['63ff4189-e02d-4d0e-a0e2-6ab8b34ecb6a', '494f7004-2f58-4923-8834-9dff4a81621c', '3bb9fa94-192e-4ccb-ac63-18bc788f2ffe', 'dc535695-e0ac-438b-a3a7-05a382bbf183'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:18 devstack sudo[103528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:18 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:18 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32228240-4a02-4378-aab5-073a59f32edb 1073741824" returned: 0 in 0.685s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32228240-4a02-4378-aab5-073a59f32edb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:18 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.397s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:18 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Deleted volume successfully.
Sep 09 04:05:18 devstack sudo[103534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32228240-4a02-4378-aab5-073a59f32edb
Sep 09 04:05:18 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-542499ca-aeda-47a4-81f3-f926ab2d21b1 tempest-VolumesActionsTest-674359614 None] Lock "cinder-32075ffc-92ee-403d-a545-bf832498ff11-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:19 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32228240-4a02-4378-aab5-073a59f32edb" returned: 0 in 0.395s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.706s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-892730563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258c4e4a-aeae-4b75-835a-1ee2fba20933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72288f96872445eb6ca52a6d9eef62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:17Z,use_quota=True,user_id='145432d829b3454a87aafff730ba9b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Creating volume 258c4e4a-aeae-4b75-835a-1ee2fba20933 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:19 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-258c4e4a-aeae-4b75-835a-1ee2fba20933 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef9d41c-1cf2-40ff-ad37-e246b0854b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32228240-4a02-4378-aab5-073a59f32edb', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:19 devstack sudo[103552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-258c4e4a-aeae-4b75-835a-1ee2fba20933 1073741824
Sep 09 04:05:19 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855f589f-f2cd-4b5a-bd5a-91d5dfec9d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:19 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume volume-32228240-4a02-4378-aab5-073a59f32edb (32228240-4a02-4378-aab5-073a59f32edb): created successfully
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855f589f-f2cd-4b5a-bd5a-91d5dfec9d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Flow 'volume_create_manager' (bafaae8a-d48a-4a77-bd2e-d207e3e6391c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:19 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f31a16e9-51f3-4fec-bd5f-6a45863eba70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Created volume successfully.
Sep 09 04:05:19 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-258c4e4a-aeae-4b75-835a-1ee2fba20933 1073741824" returned: 0 in 0.578s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-258c4e4a-aeae-4b75-835a-1ee2fba20933 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:19 devstack sudo[103563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-258c4e4a-aeae-4b75-835a-1ee2fba20933
Sep 09 04:05:19 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:20 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-258c4e4a-aeae-4b75-835a-1ee2fba20933" returned: 0 in 0.355s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.318s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1586042843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d86ec7-bd24-4ad8-8d5d-353bf40a3e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72288f96872445eb6ca52a6d9eef62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:18Z,use_quota=True,user_id='145432d829b3454a87aafff730ba9b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Creating volume 65d86ec7-bd24-4ad8-8d5d-353bf40a3e72 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:20 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9246a4b-e527-4807-b448-8eed5e5129f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-258c4e4a-aeae-4b75-835a-1ee2fba20933', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:20 devstack sudo[103566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72 1073741824
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc892f62-a0f5-40a2-987a-a2e4bc862e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:20 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:20 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume volume-258c4e4a-aeae-4b75-835a-1ee2fba20933 (258c4e4a-aeae-4b75-835a-1ee2fba20933): created successfully
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc892f62-a0f5-40a2-987a-a2e4bc862e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Flow 'volume_create_manager' (9313d0af-5102-4304-a7a4-5e5d72e1a65a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:20 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-611aee38-3754-4e13-b835-fa7a847a8ecf tempest-CreateVolumesFromSnapshotTest-1889642837 None] Created volume successfully.
Sep 09 04:05:20 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-cbc0100a-7eba-4d5f-b6b6-26371f97c7b6 tempest-TestShelveInstance-1472863577 None] Terminate volume connection completed successfully.
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-cbc0100a-7eba-4d5f-b6b6-26371f97c7b6 tempest-TestShelveInstance-1472863577 None] Deleting attachment 9f481eec-4931-435d-a7be-6a6949581563. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Acquiring lock "cinder-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Lock "cinder-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Acquiring lock "cinder-quobyte-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Lock "cinder-quobyte-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6" acquired by "delete_volume" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8179ad-6abe-4989-bf75-5432590d2320]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:20 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72 1073741824" returned: 0 in 0.650s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:20 devstack sudo[103575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72
Sep 09 04:05:20 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:20 devstack sudo[103574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6
Sep 09 04:05:20 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:21 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72" returned: 0 in 0.354s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165bb871-ca15-47a0-be00-8a176692f649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb02a51-eed5-4d9f-a56b-dd552ddf583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:21 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:21 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Volume volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72 (65d86ec7-bd24-4ad8-8d5d-353bf40a3e72): created successfully
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb02a51-eed5-4d9f-a56b-dd552ddf583f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Flow 'volume_create_manager' (66f1bfa5-bfea-4e58-8be1-b4787a136ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6" returned: 0 in 0.532s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:21 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-91bfefe4-8e35-494f-8e31-4b32810c2aa4 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Created volume successfully.
Sep 09 04:05:21 devstack sudo[103583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6
Sep 09 04:05:21 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:21 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6" returned: 0 in 0.271s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Lock "cinder-quobyte-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6" released by "delete_volume" :: held 0.847s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG cinder.quota [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Created reservations ['5d3a62d6-fc9a-4d3f-b6c3-0937196fb087', 'f9cfd843-2cfa-49b6-863a-ab84ba139997', '4b8e1da6-b164-4102-8e66-9c3ef3492970', '4fe9ed5d-c7cf-4ce5-a5dd-aa549890c099'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:21 devstack sudo[103586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:21 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:21 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.323s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:21 devstack cinder-volume[87558]: DEBUG cinder.manager [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:21 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Deleted volume successfully.
Sep 09 04:05:22 devstack cinder-volume[87558]: DEBUG cinder.coordination [req-ecf0baa6-e7fc-4c36-b9cb-8073caeb763e req-8b27cc93-e1d2-4afb-8d28-73d27369482e tempest-TestShelveInstance-1472863577 None] Lock "cinder-55dda9e0-a4f9-4e6d-8423-e23a2ee3bde6-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:22 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:22 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:22 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-quobyte-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:22 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72" acquired by "delete_volume" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:22 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d6be59-77d9-406b-ae61-7659e1dbbf5f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:22 devstack sudo[103589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72
Sep 09 04:05:22 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:22 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72" returned: 0 in 0.361s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:22 devstack sudo[103594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72
Sep 09 04:05:22 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:23 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72" returned: 0 in 0.275s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72" released by "delete_volume" :: held 0.702s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Created reservations ['d6bad23a-d69d-48f7-b840-23bb708ed8c7', '6f129314-76c7-405d-a66b-9cac75d6c675', '089ca82f-18d3-4809-9d3d-32f68b41e503', 'ff55e24c-728d-45e7-9f48-3664cee09012'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:23 devstack sudo[103597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:23 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-258c4e4a-aeae-4b75-835a-1ee2fba20933-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-258c4e4a-aeae-4b75-835a-1ee2fba20933-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=128,cinder:UPDATE=180,cinder:INSERT=44,cinder:DELETE=21 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:05:23 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-quobyte-258c4e4a-aeae-4b75-835a-1ee2fba20933" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.354s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:23 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Deleted volume successfully.
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=138,cinder:UPDATE=170,cinder:INSERT=43,cinder:DELETE=12 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-258c4e4a-aeae-4b75-835a-1ee2fba20933" acquired by "delete_volume" :: waited 0.036s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[99790051-6b4f-4c4b-a081-126589770ce4]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-258c4e4a-aeae-4b75-835a-1ee2fba20933 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-06bafeac-4697-4ba2-9fe0-31ab226c4de0 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-65d86ec7-bd24-4ad8-8d5d-353bf40a3e72-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:23 devstack sudo[103604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-258c4e4a-aeae-4b75-835a-1ee2fba20933
Sep 09 04:05:23 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:24 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-258c4e4a-aeae-4b75-835a-1ee2fba20933" returned: 0 in 0.470s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-258c4e4a-aeae-4b75-835a-1ee2fba20933 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:24 devstack sudo[103613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-258c4e4a-aeae-4b75-835a-1ee2fba20933
Sep 09 04:05:24 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:24 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-258c4e4a-aeae-4b75-835a-1ee2fba20933" returned: 0 in 0.264s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-258c4e4a-aeae-4b75-835a-1ee2fba20933" released by "delete_volume" :: held 0.795s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Created reservations ['afdb801d-c333-409f-b19f-7a77c578fbbd', '4bd0d7de-2949-4d50-83ab-45250b179afb', 'bfabd9b9-de90-46e3-bb7f-af19043baf8c', '86382c24-ea17-431b-87f6-1a089cd6c5e0'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:24 devstack sudo[103616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:24 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-32228240-4a02-4378-aab5-073a59f32edb-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-32228240-4a02-4378-aab5-073a59f32edb-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-quobyte-32228240-4a02-4378-aab5-073a59f32edb" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-32228240-4a02-4378-aab5-073a59f32edb" acquired by "delete_volume" :: waited 0.038s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ff64b4-cdfb-4a92-a460-8af0b4901ae9]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32228240-4a02-4378-aab5-073a59f32edb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:24 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.343s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:24 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Deleted volume successfully.
Sep 09 04:05:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6fd0ffaf-46d0-448d-8da6-25af9e2d4480 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-258c4e4a-aeae-4b75-835a-1ee2fba20933-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:25 devstack sudo[103619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32228240-4a02-4378-aab5-073a59f32edb
Sep 09 04:05:25 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:25 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32228240-4a02-4378-aab5-073a59f32edb" returned: 0 in 0.393s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32228240-4a02-4378-aab5-073a59f32edb {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:25 devstack sudo[103625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32228240-4a02-4378-aab5-073a59f32edb
Sep 09 04:05:25 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:25 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-32228240-4a02-4378-aab5-073a59f32edb" returned: 0 in 0.259s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:25 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-32228240-4a02-4378-aab5-073a59f32edb" released by "delete_volume" :: held 0.702s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:25 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Created reservations ['d02cfeea-68fa-4f20-b9ea-946bfef73dc6', '131bd6b8-db1b-4586-9867-f522939aca41', 'c8fb6792-1ca1-4eac-9c6e-bb2d4385877c', 'f3598755-6b0e-4df9-93c2-cf5a11124289'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:25 devstack sudo[103628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:25 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:26 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.324s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-65049b4f-5e19-45ed-82a2-2145c7ec0e96-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:26 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Deleted volume successfully.
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-65049b4f-5e19-45ed-82a2-2145c7ec0e96-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f63d49c1-9ee6-4d7d-be96-d850232bc6f7 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-32228240-4a02-4378-aab5-073a59f32edb-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-quobyte-65049b4f-5e19-45ed-82a2-2145c7ec0e96" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-65049b4f-5e19-45ed-82a2-2145c7ec0e96" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1cf1ad-7320-496d-9604-8c0f37a09a8a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:26 devstack sudo[103632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96
Sep 09 04:05:26 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:26 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96" returned: 0 in 0.418s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:26 devstack sudo[103638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96
Sep 09 04:05:26 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:26 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-65049b4f-5e19-45ed-82a2-2145c7ec0e96" returned: 0 in 0.358s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:27 devstack sudo[103642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:27 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-65049b4f-5e19-45ed-82a2-2145c7ec0e96" released by "delete_volume" :: held 0.843s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Created reservations ['679f9364-ce50-4c72-8786-af4388bf5825', 'd9efc865-87b9-40aa-8526-693b891af1e1', '56e0a511-478e-4e56-a671-b9183c3e63b0', '923c5a36-3919-4aa2-956a-f4bc888e99d0'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:27 devstack sudo[103644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:27 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:27 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.330s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-5b947772-5bf5-48d2-8bcf-c2ee1cd88461-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-5b947772-5bf5-48d2-8bcf-c2ee1cd88461-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-quobyte-5b947772-5bf5-48d2-8bcf-c2ee1cd88461" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-5b947772-5bf5-48d2-8bcf-c2ee1cd88461" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[57936811-d618-47db-a6e4-fc78b529053a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:27 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.354s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:27 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Deleted volume successfully.
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a44858c4-f195-4f58-8457-646a0ff6c0fd tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-65049b4f-5e19-45ed-82a2-2145c7ec0e96-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:27 devstack sudo[103647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461
Sep 09 04:05:27 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:27 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461" returned: 0 in 0.382s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:27 devstack sudo[103653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461
Sep 09 04:05:27 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:28 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5b947772-5bf5-48d2-8bcf-c2ee1cd88461" returned: 0 in 0.297s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-5b947772-5bf5-48d2-8bcf-c2ee1cd88461" released by "delete_volume" :: held 0.727s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Created reservations ['803b76c9-858d-4b47-ae15-ea657000d378', '8eae3d14-117e-445d-b3b1-3c3f11d374bf', '18ff49d9-2dc9-408c-a996-a96892f06a72', '4abc72b2-925c-4b38-b3fd-5ca886aca885'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:28 devstack sudo[103656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:28 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-34e38054-d2f8-4dc5-982d-5c472da93a3e-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-34e38054-d2f8-4dc5-982d-5c472da93a3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-quobyte-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-quobyte-34e38054-d2f8-4dc5-982d-5c472da93a3e" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-34e38054-d2f8-4dc5-982d-5c472da93a3e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Deleting offline snapshot 34e38054-d2f8-4dc5-982d-5c472da93a3e of volume d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] snapshot_file for this snap is: volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:05:28 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.301s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ab42c7-26c6-4344-ae85-06172aa9426a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:28 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Deleted volume successfully.
Sep 09 04:05:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-564d193a-3def-48af-994d-7bf280c7cced tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-5b947772-5bf5-48d2-8bcf-c2ee1cd88461-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:28 devstack sudo[103659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e
Sep 09 04:05:28 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:29 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e" returned: 0 in 0.425s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:05:29 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b5ec09-c68b-48bb-9063-584b62581c80]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:29 devstack sudo[103665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413
Sep 09 04:05:29 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:29 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413" returned: 0 in 0.422s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:29 devstack sudo[103671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e
Sep 09 04:05:29 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:29 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e" returned: 0 in 0.385s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:29 devstack sudo[103676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e
Sep 09 04:05:29 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:30 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413.34e38054-d2f8-4dc5-982d-5c472da93a3e" returned: 0 in 0.290s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-34e38054-d2f8-4dc5-982d-5c472da93a3e" released by "_delete_snapshot" :: held 1.644s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413" released by "delete_snapshot" :: held 1.682s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:30 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Created reservations ['75358e11-5590-4ca7-a29d-8f95d46cfbcb', '4a2df007-ee0e-44cc-8467-852e7e3426e1', '43d7e8c6-453f-45d5-b243-349e9fdfd185', 'abc0e654-22b7-49f4-bc08-7e561ff9ca52'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Delete snapshot completed successfully.
Sep 09 04:05:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-5f9eac76-e362-4d2f-badb-7b2d591213a8 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-34e38054-d2f8-4dc5-982d-5c472da93a3e-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "cinder-quobyte-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:30 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[047dce22-80c0-48f0-97f6-0a8aa09cc73f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:31 devstack sudo[103679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413
Sep 09 04:05:31 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:31 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413" returned: 0 in 0.426s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:31 devstack sudo[103684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413
Sep 09 04:05:31 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:31 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413" returned: 0 in 0.292s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-quobyte-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413" released by "delete_volume" :: held 0.800s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:31 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Created reservations ['c6af074d-5f1f-490f-bd34-7baa36424632', '2806b428-aad4-40f6-87a8-dc8c9838a4e1', '9be2d755-c48a-4fc7-b6db-e63de175e346', '2b4064f7-4b8f-4202-bd9e-a4f02feb30e8'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:31 devstack sudo[103687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:31 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:32 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.400s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:32 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:32 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Deleted volume successfully.
Sep 09 04:05:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7205b4bf-8ec3-427a-9bdf-57a6078aed70 tempest-CreateVolumesFromSnapshotTest-1889642837 None] Lock "cinder-d9ba0d6a-30f4-4bd4-9bfd-e93baa1fa413-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Flow 'volume_create_manager' (d2f49271-f9ed-46b8-a1d9-7f2b85cdc1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de495f6-4212-463a-95bc-fccfd614eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de495f6-4212-463a-95bc-fccfd614eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-484296067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7731ba-94c2-49d0-aa8d-066ff5d1ffff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f55256a358b41efa9cdcc360a90181f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:35Z,use_quota=True,user_id='0d5f167d5e2d4efeae6552edb6e4b5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49021434-24ff-45b5-bd5a-259ed2b3e8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49021434-24ff-45b5-bd5a-259ed2b3e8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42a2035-6cfb-4560-a27e-1751805499d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42a2035-6cfb-4560-a27e-1751805499d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de7731ba-94c2-49d0-aa8d-066ff5d1ffff', 'volume_name': 'volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c90a28-167a-4b1b-9fa5-94d599e3976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c90a28-167a-4b1b-9fa5-94d599e3976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859f388c-39fb-4638-b4cf-8819021c4d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:34 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Volume de7731ba-94c2-49d0-aa8d-066ff5d1ffff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff', 'volume_size': 1}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-484296067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7731ba-94c2-49d0-aa8d-066ff5d1ffff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f55256a358b41efa9cdcc360a90181f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:35Z,use_quota=True,user_id='0d5f167d5e2d4efeae6552edb6e4b5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Creating volume de7731ba-94c2-49d0-aa8d-066ff5d1ffff {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:34 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:34 devstack sudo[103694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff 1073741824
Sep 09 04:05:35 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:35 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff 1073741824" returned: 0 in 0.506s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:35 devstack sudo[103701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff
Sep 09 04:05:35 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:35 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff" returned: 0 in 0.261s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859f388c-39fb-4638-b4cf-8819021c4d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada9ae84-dbb5-46fe-a7ec-3e59a573b197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:35 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Volume volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff (de7731ba-94c2-49d0-aa8d-066ff5d1ffff): created successfully
Sep 09 04:05:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada9ae84-dbb5-46fe-a7ec-3e59a573b197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Flow 'volume_create_manager' (d2f49271-f9ed-46b8-a1d9-7f2b85cdc1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:35 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e48d0e91-2c6e-4a4b-a764-818fd5584301 tempest-VolumesCloneTest-96398426 None] Created volume successfully.
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Flow 'volume_create_manager' (dae2aaad-953a-4209-b446-4117fed8c9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e55485f-cf15-4fdd-8b46-d8932c9c3513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e55485f-cf15-4fdd-8b46-d8932c9c3513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01925546-d511-43b8-8c8b-2469b906787d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d343b0f55424b9db95c4f7c37cea020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:36Z,use_quota=True,user_id='1610b4ede69e42e483b09d4a281ca332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85f2575-1c49-4c62-b0c3-ecc4111559d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85f2575-1c49-4c62-b0c3-ecc4111559d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc512d2-ff5d-44cf-84f1-eb90c817492b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc512d2-ff5d-44cf-84f1-eb90c817492b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01925546-d511-43b8-8c8b-2469b906787d', 'volume_name': 'volume-01925546-d511-43b8-8c8b-2469b906787d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c496079a-276b-46b7-b8a5-229cc1dc5ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c496079a-276b-46b7-b8a5-229cc1dc5ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7562da01-d727-4bf2-993a-71da74584a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Volume 01925546-d511-43b8-8c8b-2469b906787d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01925546-d511-43b8-8c8b-2469b906787d', 'volume_size': 1}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01925546-d511-43b8-8c8b-2469b906787d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d343b0f55424b9db95c4f7c37cea020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:36Z,use_quota=True,user_id='1610b4ede69e42e483b09d4a281ca332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Creating volume 01925546-d511-43b8-8c8b-2469b906787d {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:36 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-01925546-d511-43b8-8c8b-2469b906787d 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:36 devstack sudo[103706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-01925546-d511-43b8-8c8b-2469b906787d 1073741824
Sep 09 04:05:36 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Flow 'volume_create_manager' (d3303e0e-1030-4bb4-afff-824343b93c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1aa5d8-0991-43ae-bd3f-d0d415c5c242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1aa5d8-0991-43ae-bd3f-d0d415c5c242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699800857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb4cc51-ad9e-4976-9530-670f43b99b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d977e66e34633a6294eec2c5952c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:37Z,use_quota=True,user_id='d0d889e0126045ecbcf11716a0c93348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e58c66-9837-4775-95b2-cf7e45d5f218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e58c66-9837-4775-95b2-cf7e45d5f218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613564d5-6054-4cd4-b959-41667a871c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613564d5-6054-4cd4-b959-41667a871c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb4cc51-ad9e-4976-9530-670f43b99b80', 'volume_name': 'volume-cbb4cc51-ad9e-4976-9530-670f43b99b80', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a8f05e-6759-4ad0-a859-77786e2480a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a8f05e-6759-4ad0-a859-77786e2480a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b001427d-8d97-4f5c-b45e-9af75b59ea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume cbb4cc51-ad9e-4976-9530-670f43b99b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb4cc51-ad9e-4976-9530-670f43b99b80', 'volume_size': 1}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Flow 'volume_create_manager' (a30741bb-a4df-4449-a20a-4872625f495f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4f56e5-dfa4-4945-8805-8313531e2e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4f56e5-dfa4-4945-8805-8313531e2e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1362944749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b733acc3-8b01-4b56-8850-97ec5a6acbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f55256a358b41efa9cdcc360a90181f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=de7731ba-94c2-49d0-aa8d-066ff5d1ffff,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:37Z,use_quota=True,user_id='0d5f167d5e2d4efeae6552edb6e4b5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf58b26-22ea-41a5-99b4-6a2c2b184222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf58b26-22ea-41a5-99b4-6a2c2b184222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc4059b-3a52-4620-b28f-85c5c4c5b403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc4059b-3a52-4620-b28f-85c5c4c5b403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b733acc3-8b01-4b56-8850-97ec5a6acbf4', 'volume_name': 'volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4', 'volume_size': 2, 'source_volid': 'de7731ba-94c2-49d0-aa8d-066ff5d1ffff', 'source_volstatus': 'available'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c52b763-bbc4-4e57-8427-0501688d3243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c52b763-bbc4-4e57-8427-0501688d3243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8216a6-eb9a-44cc-878b-1479f9d611ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:36 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Volume b733acc3-8b01-4b56-8850-97ec5a6acbf4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4', 'volume_size': 2, 'source_volid': 'de7731ba-94c2-49d0-aa8d-066ff5d1ffff', 'source_volstatus': 'available'}
Sep 09 04:05:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:37 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-01925546-d511-43b8-8c8b-2469b906787d 1073741824" returned: 0 in 0.421s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-01925546-d511-43b8-8c8b-2469b906787d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:37 devstack sudo[103712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-01925546-d511-43b8-8c8b-2469b906787d
Sep 09 04:05:37 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:37 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-01925546-d511-43b8-8c8b-2469b906787d" returned: 0 in 0.254s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.599s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699800857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb4cc51-ad9e-4976-9530-670f43b99b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d977e66e34633a6294eec2c5952c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:37Z,use_quota=True,user_id='d0d889e0126045ecbcf11716a0c93348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Creating volume cbb4cc51-ad9e-4976-9530-670f43b99b80 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:37 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbb4cc51-ad9e-4976-9530-670f43b99b80 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7562da01-d727-4bf2-993a-71da74584a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01925546-d511-43b8-8c8b-2469b906787d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:37 devstack sudo[103715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbb4cc51-ad9e-4976-9530-670f43b99b80 1073741824
Sep 09 04:05:37 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4de0076-2223-426d-8e78-c0a934676679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:37 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Volume volume-01925546-d511-43b8-8c8b-2469b906787d (01925546-d511-43b8-8c8b-2469b906787d): created successfully
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4de0076-2223-426d-8e78-c0a934676679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Flow 'volume_create_manager' (dae2aaad-953a-4209-b446-4117fed8c9d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:37 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-50845fa0-d2d9-4f69-a1e0-cbee64ce1e97 tempest-CinderUnicodeTest-1222434814 None] Created volume successfully.
Sep 09 04:05:37 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbb4cc51-ad9e-4976-9530-670f43b99b80 1073741824" returned: 0 in 0.414s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbb4cc51-ad9e-4976-9530-670f43b99b80 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:37 devstack sudo[103720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbb4cc51-ad9e-4976-9530-670f43b99b80
Sep 09 04:05:37 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:38 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbb4cc51-ad9e-4976-9530-670f43b99b80" returned: 0 in 0.240s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.147s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:38 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Cloning volume de7731ba-94c2-49d0-aa8d-066ff5d1ffff to volume b733acc3-8b01-4b56-8850-97ec5a6acbf4
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b001427d-8d97-4f5c-b45e-9af75b59ea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb4cc51-ad9e-4976-9530-670f43b99b80', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928c36b3-e6d9-4cd5-98ec-30e4a42cf60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:38 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume volume-cbb4cc51-ad9e-4976-9530-670f43b99b80 (cbb4cc51-ad9e-4976-9530-670f43b99b80): created successfully
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928c36b3-e6d9-4cd5-98ec-30e4a42cf60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Flow 'volume_create_manager' (d3303e0e-1030-4bb4-afff-824343b93c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Creating offline snapshot 9f8ace46-f9f3-4ce4-887d-6a826706655c of volume de7731ba-94c2-49d0-aa8d-066ff5d1ffff {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:05:38 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7bdcbb51-36b2-45de-b2aa-954f3070cecb tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Created volume successfully.
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[386e3e89-6930-4e0c-8df1-66e1cb0b1829]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:38 devstack sudo[103723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff
Sep 09 04:05:38 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:38 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff" returned: 0 in 0.366s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:38 devstack sudo[103728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c 1G
Sep 09 04:05:38 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:38 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:39 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Flow 'volume_create_manager' (296e1bc7-a78e-44ed-be0b-29b9eea65b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00138fd-8c67-445e-8641-318693ba0361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c 1G" returned: 0 in 0.544s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00138fd-8c67-445e-8641-318693ba0361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1830688315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00ff99f-4601-4e73-9ac9-d2b7ff2d3421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d977e66e34633a6294eec2c5952c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:39Z,use_quota=True,user_id='d0d889e0126045ecbcf11716a0c93348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack sudo[103734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d8e92d-d6e1-4a4a-ae5d-59402b8f9407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d8e92d-d6e1-4a4a-ae5d-59402b8f9407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70258b3-5ab1-4c47-830e-e77cebdfdb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70258b3-5ab1-4c47-830e-e77cebdfdb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e00ff99f-4601-4e73-9ac9-d2b7ff2d3421', 'volume_name': 'volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f13c94-413f-4b5a-a335-38a8901ac1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f13c94-413f-4b5a-a335-38a8901ac1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae67da7-10a9-4b85-b8bf-20424fc8bdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume e00ff99f-4601-4e73-9ac9-d2b7ff2d3421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421', 'volume_size': 1}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Flow 'volume_create_manager' (d674df0c-159b-4ea8-8e5a-08e53b87d946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f625c5b6-5e90-47bd-bd5b-c7c098e0a284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f625c5b6-5e90-47bd-bd5b-c7c098e0a284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1024351244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a9e1c5-ca23-4a63-a912-70421581784d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d343b0f55424b9db95c4f7c37cea020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:39Z,use_quota=True,user_id='1610b4ede69e42e483b09d4a281ca332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30fc5e39-9b52-4af8-ae75-44f43c37894c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30fc5e39-9b52-4af8-ae75-44f43c37894c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d311dbef-b8d0-4c9b-af56-2bbaf4398775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d311dbef-b8d0-4c9b-af56-2bbaf4398775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6a9e1c5-ca23-4a63-a912-70421581784d', 'volume_name': 'volume-b6a9e1c5-ca23-4a63-a912-70421581784d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd56696c-9488-48ea-8e48-2ae397fe10f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd56696c-9488-48ea-8e48-2ae397fe10f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c31e950-d1a1-4942-b382-25376ebde763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Volume b6a9e1c5-ca23-4a63-a912-70421581784d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6a9e1c5-ca23-4a63-a912-70421581784d', 'volume_size': 1}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Flow 'volume_create_manager' (eadac208-0622-4816-80cf-687928738419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5276853b-6093-4641-946d-13348ffafb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5276853b-6093-4641-946d-13348ffafb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-795754150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02e5cc7-4a3d-4e73-a726-a68f393b708f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d977e66e34633a6294eec2c5952c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:39Z,use_quota=True,user_id='d0d889e0126045ecbcf11716a0c93348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41f8562-582e-40ed-932e-3640605c9cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41f8562-582e-40ed-932e-3640605c9cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c67daf-163f-4651-909d-428ff47383b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c67daf-163f-4651-909d-428ff47383b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a02e5cc7-4a3d-4e73-a726-a68f393b708f', 'volume_name': 'volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed3f269-dbad-42e4-9e04-2267bb9e5f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed3f269-dbad-42e4-9e04-2267bb9e5f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d50f183-5d62-43ab-86d2-8e688ddf2ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume a02e5cc7-4a3d-4e73-a726-a68f393b708f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f', 'volume_size': 1}
Sep 09 04:05:39 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c" returned: 0 in 0.407s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:39 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c is being set with open permissions: ugo+rw
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:39 devstack sudo[103739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c
Sep 09 04:05:39 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:39 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c" returned: 0 in 0.270s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Flow 'volume_create_manager' (dafa2275-756f-4a9e-af62-66f7c0b2541b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:39 devstack sudo[103742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.info
Sep 09 04:05:39 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b199206-0f03-4071-8491-132804f1158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b199206-0f03-4071-8491-132804f1158b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1653292106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d894a8-acaf-4c0b-abd2-492d8f019796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d977e66e34633a6294eec2c5952c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:40Z,use_quota=True,user_id='d0d889e0126045ecbcf11716a0c93348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf9a63e-55b7-4bbd-b1d2-70cf3d559f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf9a63e-55b7-4bbd-b1d2-70cf3d559f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa25074-cef8-4800-affa-70c0c9de749f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa25074-cef8-4800-affa-70c0c9de749f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6d894a8-acaf-4c0b-abd2-492d8f019796', 'volume_name': 'volume-f6d894a8-acaf-4c0b-abd2-492d8f019796', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7c3eb8-5844-4020-a330-5e13b377e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7c3eb8-5844-4020-a330-5e13b377e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e5552c-740e-4d4a-aba7-a2f647bebef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:39 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume f6d894a8-acaf-4c0b-abd2-492d8f019796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6d894a8-acaf-4c0b-abd2-492d8f019796', 'volume_size': 1}
Sep 09 04:05:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:40 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.info" returned: 0 in 0.325s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:40 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.info is being set with open permissions: ugo+rw
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:40 devstack sudo[103745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.info
Sep 09 04:05:40 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Flow 'volume_create_manager' (4ecb876a-be1b-4025-9025-09e55a860140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74152d9-ef32-4058-807a-11d413f9039d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74152d9-ef32-4058-807a-11d413f9039d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1710201667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d54447f-ef0b-45e2-bde2-979047e0fa8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d977e66e34633a6294eec2c5952c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:40Z,use_quota=True,user_id='d0d889e0126045ecbcf11716a0c93348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f814ee3-fcef-4d8e-87a2-03f21fb23e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f814ee3-fcef-4d8e-87a2-03f21fb23e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a307fd5-5d1c-414c-aab2-56309992a7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a307fd5-5d1c-414c-aab2-56309992a7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d54447f-ef0b-45e2-bde2-979047e0fa8a', 'volume_name': 'volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928cd2c6-230f-408e-9492-6fede07cbdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928cd2c6-230f-408e-9492-6fede07cbdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7446c7fe-b70e-4b5b-8764-f7dccfad06bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:40 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume 2d54447f-ef0b-45e2-bde2-979047e0fa8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a', 'volume_size': 1}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:40 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.info" returned: 0 in 0.269s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Acquiring lock "cinder-quobyte-b733acc3-8b01-4b56-8850-97ec5a6acbf4" by "_copy_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Lock "cinder-quobyte-b733acc3-8b01-4b56-8850-97ec5a6acbf4" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] snapshot: 9f8ace46-f9f3-4ce4-887d-6a826706655c, volume: b733acc3-8b01-4b56-8850-97ec5a6acbf4,  {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5df68a6-60a5-4fbf-953c-6409f0455211]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Flow 'volume_create_manager' (eed6ca6b-dfd3-4e3c-8ab8-47e5de25b045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e0c441-1bf8-432c-b5e4-a4472a091f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e0c441-1bf8-432c-b5e4-a4472a091f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-524311361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4aa62e-248c-4d17-8a25-081fbc677c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d977e66e34633a6294eec2c5952c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:40Z,use_quota=True,user_id='d0d889e0126045ecbcf11716a0c93348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb89867-e07f-4266-a17d-8d9c8b45a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb89867-e07f-4266-a17d-8d9c8b45a936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f31794b-b746-481d-a0f1-efa0654a73ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f31794b-b746-481d-a0f1-efa0654a73ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4aa62e-248c-4d17-8a25-081fbc677c86', 'volume_name': 'volume-fd4aa62e-248c-4d17-8a25-081fbc677c86', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6be4db-2080-4a60-8ed1-438dacfe7553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:40 devstack sudo[103748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c
Sep 09 04:05:40 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6be4db-2080-4a60-8ed1-438dacfe7553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554294ca-c4de-446a-b7b9-a5ecc2fe5a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:40 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume fd4aa62e-248c-4d17-8a25-081fbc677c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4aa62e-248c-4d17-8a25-081fbc677c86', 'volume_size': 1}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:40 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c" returned: 0 in 0.363s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc4b410-145b-44e9-9ac7-6a37383aa97b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:40 devstack sudo[103753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff
Sep 09 04:05:40 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:41 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff" returned: 0 in 0.357s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 04:05:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Creating direct copy from snapshot {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 04:05:41 devstack cinder-volume[87558]: DEBUG cinder.utils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Path /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4 not found in is_blk_device check {{(pid=87558) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 04:05:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:41 devstack sudo[103758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4
Sep 09 04:05:41 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:45 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4" returned: 0 in 4.065s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff, size 1024.00 MB, duration 4.07 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4 {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 04:05:45 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Converted 1024.00 MB image at 251.82 MB/s
Sep 09 04:05:45 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4 is being set with open permissions: ugo+rw
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:45 devstack sudo[103772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4
Sep 09 04:05:45 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:45 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4" returned: 0 in 0.244s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Lock "cinder-quobyte-b733acc3-8b01-4b56-8850-97ec5a6acbf4" released by "_copy_volume_from_snapshot" :: held 5.104s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Acquiring lock "cinder-quobyte-9f8ace46-f9f3-4ce4-887d-6a826706655c" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Lock "cinder-quobyte-9f8ace46-f9f3-4ce4-887d-6a826706655c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Deleting offline snapshot 9f8ace46-f9f3-4ce4-887d-6a826706655c of volume de7731ba-94c2-49d0-aa8d-066ff5d1ffff {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] snapshot_file for this snap is: volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c651911f-52b5-4988-ac56-01cebe134850]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:45 devstack sudo[103775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c
Sep 09 04:05:45 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:45 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c" returned: 0 in 0.342s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd8f874-83fd-460e-b0f6-a1b723739b8e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:46 devstack sudo[103780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff
Sep 09 04:05:46 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:46 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff" returned: 0 in 0.480s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:46 devstack sudo[103785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c
Sep 09 04:05:46 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:46 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c" returned: 0 in 0.331s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:46 devstack sudo[103790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c
Sep 09 04:05:46 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:46 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff.9f8ace46-f9f3-4ce4-887d-6a826706655c" returned: 0 in 0.256s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Lock "cinder-quobyte-9f8ace46-f9f3-4ce4-887d-6a826706655c" released by "_delete_snapshot" :: held 1.489s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.990s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.910s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1830688315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00ff99f-4601-4e73-9ac9-d2b7ff2d3421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d977e66e34633a6294eec2c5952c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:39Z,use_quota=True,user_id='d0d889e0126045ecbcf11716a0c93348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Creating volume e00ff99f-4601-4e73-9ac9-d2b7ff2d3421 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:47 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8216a6-eb9a-44cc-878b-1479f9d611ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4', 'volume_size': 2, 'source_volid': 'de7731ba-94c2-49d0-aa8d-066ff5d1ffff', 'source_volstatus': 'available'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:47 devstack sudo[103793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421 1073741824
Sep 09 04:05:47 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f303e4d9-7477-4880-a2c2-cdcb914aaf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:47 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Volume volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4 (b733acc3-8b01-4b56-8850-97ec5a6acbf4): created successfully
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f303e4d9-7477-4880-a2c2-cdcb914aaf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Flow 'volume_create_manager' (a30741bb-a4df-4449-a20a-4872625f495f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:47 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b806ec6d-7797-4334-984c-8e819fc06a18 tempest-VolumesCloneTest-96398426 None] Created volume successfully.
Sep 09 04:05:47 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421 1073741824" returned: 0 in 0.401s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:47 devstack sudo[103798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421
Sep 09 04:05:47 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:47 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421" returned: 0 in 0.266s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.476s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1024351244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a9e1c5-ca23-4a63-a912-70421581784d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d343b0f55424b9db95c4f7c37cea020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:39Z,use_quota=True,user_id='1610b4ede69e42e483b09d4a281ca332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Creating volume b6a9e1c5-ca23-4a63-a912-70421581784d {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:47 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:47 devstack sudo[103801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d 1073741824
Sep 09 04:05:47 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae67da7-10a9-4b85-b8bf-20424fc8bdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1099ba2-8fde-4cf8-9af6-74da2f0aa3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:47 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421 (e00ff99f-4601-4e73-9ac9-d2b7ff2d3421): created successfully
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1099ba2-8fde-4cf8-9af6-74da2f0aa3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Flow 'volume_create_manager' (296e1bc7-a78e-44ed-be0b-29b9eea65b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:47 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-36855a74-cad0-4b81-bf8e-022a5b93b7ff tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Created volume successfully.
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Acquiring lock "cinder-b733acc3-8b01-4b56-8850-97ec5a6acbf4-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Lock "cinder-b733acc3-8b01-4b56-8850-97ec5a6acbf4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Acquiring lock "cinder-quobyte-b733acc3-8b01-4b56-8850-97ec5a6acbf4" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Lock "cinder-quobyte-b733acc3-8b01-4b56-8850-97ec5a6acbf4" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28f6d19-d4fc-478e-96af-d2b14c102e70]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:48 devstack sudo[103806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4
Sep 09 04:05:48 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:48 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d 1073741824" returned: 0 in 0.445s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:48 devstack sudo[103808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d
Sep 09 04:05:48 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:48 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4" returned: 0 in 0.364s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:48 devstack sudo[103814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4
Sep 09 04:05:48 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:48 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d" returned: 0 in 0.237s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.036s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-795754150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02e5cc7-4a3d-4e73-a726-a68f393b708f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d977e66e34633a6294eec2c5952c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:39Z,use_quota=True,user_id='d0d889e0126045ecbcf11716a0c93348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Creating volume a02e5cc7-4a3d-4e73-a726-a68f393b708f {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:48 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c31e950-d1a1-4942-b382-25376ebde763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a9e1c5-ca23-4a63-a912-70421581784d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:48 devstack sudo[103816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f 1073741824
Sep 09 04:05:48 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42828b98-dc1f-4e49-af37-5854646f02ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:48 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Volume volume-b6a9e1c5-ca23-4a63-a912-70421581784d (b6a9e1c5-ca23-4a63-a912-70421581784d): created successfully
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42828b98-dc1f-4e49-af37-5854646f02ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Flow 'volume_create_manager' (d674df0c-159b-4ea8-8e5a-08e53b87d946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:48 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-801d568f-27fa-44e5-b693-8604299da13e tempest-CinderUnicodeTest-1222434814 None] Created volume successfully.
Sep 09 04:05:48 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b733acc3-8b01-4b56-8850-97ec5a6acbf4" returned: 0 in 0.267s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Lock "cinder-quobyte-b733acc3-8b01-4b56-8850-97ec5a6acbf4" released by "delete_volume" :: held 0.678s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Created reservations ['5ace5d1c-9e44-4cc6-9c75-a707d7e1b9f2', '82ea27d0-12c3-4228-b603-b010a5823717', 'dd110e96-97bd-4b61-860a-4d6ae502ee5e', '2f5012a4-b66e-458c-9bf5-9e39173c1459'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:48 devstack sudo[103823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:48 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:49 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f 1073741824" returned: 0 in 0.528s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:49 devstack sudo[103825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f
Sep 09 04:05:49 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Acquiring lock "cinder-de7731ba-94c2-49d0-aa8d-066ff5d1ffff-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:49 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.348s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Lock "cinder-de7731ba-94c2-49d0-aa8d-066ff5d1ffff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:49 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Deleted volume successfully.
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-cea97eaa-339f-4871-b207-e9e22c2f429c tempest-VolumesCloneTest-96398426 None] Lock "cinder-b733acc3-8b01-4b56-8850-97ec5a6acbf4-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Acquiring lock "cinder-quobyte-de7731ba-94c2-49d0-aa8d-066ff5d1ffff" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Lock "cinder-quobyte-de7731ba-94c2-49d0-aa8d-066ff5d1ffff" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ce8874-6383-4f4a-aa1d-897fcd8255a6]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:49 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f" returned: 0 in 0.301s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.556s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1653292106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d894a8-acaf-4c0b-abd2-492d8f019796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d977e66e34633a6294eec2c5952c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:40Z,use_quota=True,user_id='d0d889e0126045ecbcf11716a0c93348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Creating volume f6d894a8-acaf-4c0b-abd2-492d8f019796 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:49 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f6d894a8-acaf-4c0b-abd2-492d8f019796 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d50f183-5d62-43ab-86d2-8e688ddf2ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:49 devstack sudo[103830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f6d894a8-acaf-4c0b-abd2-492d8f019796 1073741824
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e850102-dcbc-40e4-a373-af2a74595e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:49 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:49 devstack sudo[103828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff
Sep 09 04:05:49 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:49 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f (a02e5cc7-4a3d-4e73-a726-a68f393b708f): created successfully
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e850102-dcbc-40e4-a373-af2a74595e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Flow 'volume_create_manager' (eadac208-0622-4816-80cf-687928738419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:49 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f54bfd6b-ed2d-4998-a411-eeb8f1e1f0a8 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Created volume successfully.
Sep 09 04:05:49 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff" returned: 0 in 0.365s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:49 devstack sudo[103839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff
Sep 09 04:05:49 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:49 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f6d894a8-acaf-4c0b-abd2-492d8f019796 1073741824" returned: 0 in 0.450s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f6d894a8-acaf-4c0b-abd2-492d8f019796 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:49 devstack sudo[103842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f6d894a8-acaf-4c0b-abd2-492d8f019796
Sep 09 04:05:49 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:49 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de7731ba-94c2-49d0-aa8d-066ff5d1ffff" returned: 0 in 0.270s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Lock "cinder-quobyte-de7731ba-94c2-49d0-aa8d-066ff5d1ffff" released by "delete_volume" :: held 0.685s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Created reservations ['6f56f9a0-4769-4a07-a5f5-5dbf5bf82f15', 'ade53b44-09c7-469e-9834-da3dc3725225', 'eeacb794-6872-4ec3-86b6-15d562b09fb2', 'a9ead49c-d665-4339-b19a-c25de3052970'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:50 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:50 devstack sudo[103846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:50 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f6d894a8-acaf-4c0b-abd2-492d8f019796" returned: 0 in 0.248s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.977s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1710201667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d54447f-ef0b-45e2-bde2-979047e0fa8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d977e66e34633a6294eec2c5952c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:40Z,use_quota=True,user_id='d0d889e0126045ecbcf11716a0c93348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Creating volume 2d54447f-ef0b-45e2-bde2-979047e0fa8a {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:50 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e5552c-740e-4d4a-aba7-a2f647bebef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d894a8-acaf-4c0b-abd2-492d8f019796', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:50 devstack sudo[103848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a 1073741824
Sep 09 04:05:50 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a16f999-d588-426e-920f-1b95dcc9fabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:50 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume volume-f6d894a8-acaf-4c0b-abd2-492d8f019796 (f6d894a8-acaf-4c0b-abd2-492d8f019796): created successfully
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a16f999-d588-426e-920f-1b95dcc9fabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Flow 'volume_create_manager' (dafa2275-756f-4a9e-af62-66f7c0b2541b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:50 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6682f1e1-177c-47aa-9112-b2bb2a22ee7e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Created volume successfully.
Sep 09 04:05:50 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.284s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:50 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Deleted volume successfully.
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-41772378-5dbe-4dcc-a6c5-b25378bf4ea5 tempest-VolumesCloneTest-96398426 None] Lock "cinder-de7731ba-94c2-49d0-aa8d-066ff5d1ffff-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:50 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a 1073741824" returned: 0 in 0.480s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:50 devstack sudo[103855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a
Sep 09 04:05:50 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:50 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a" returned: 0 in 0.270s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.414s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-524311361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4aa62e-248c-4d17-8a25-081fbc677c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d977e66e34633a6294eec2c5952c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:40Z,use_quota=True,user_id='d0d889e0126045ecbcf11716a0c93348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Creating volume fd4aa62e-248c-4d17-8a25-081fbc677c86 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:50 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4aa62e-248c-4d17-8a25-081fbc677c86 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7446c7fe-b70e-4b5b-8764-f7dccfad06bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:50 devstack sudo[103858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4aa62e-248c-4d17-8a25-081fbc677c86 1073741824
Sep 09 04:05:50 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:50 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfdde72-975b-4579-b3ac-af14fb389c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:51 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a (2d54447f-ef0b-45e2-bde2-979047e0fa8a): created successfully
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfdde72-975b-4579-b3ac-af14fb389c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Flow 'volume_create_manager' (4ecb876a-be1b-4025-9025-09e55a860140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9f65cc97-1f6f-4e0a-88be-0c0ac5370fc6 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Created volume successfully.
Sep 09 04:05:51 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4aa62e-248c-4d17-8a25-081fbc677c86 1073741824" returned: 0 in 0.496s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4aa62e-248c-4d17-8a25-081fbc677c86 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:51 devstack sudo[103864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4aa62e-248c-4d17-8a25-081fbc677c86
Sep 09 04:05:51 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:51 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4aa62e-248c-4d17-8a25-081fbc677c86" returned: 0 in 0.284s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.646s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] Creating offline snapshot 993b0c40-43d3-4b15-851e-61bc4b9f42b8 of volume b6a9e1c5-ca23-4a63-a912-70421581784d {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554294ca-c4de-446a-b7b9-a5ecc2fe5a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4aa62e-248c-4d17-8a25-081fbc677c86', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b03b2c4-a4f9-4c5b-988b-2a21f5007e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab0fd6-3533-4d44-80fb-40d1adebf825]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:51 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Volume volume-fd4aa62e-248c-4d17-8a25-081fbc677c86 (fd4aa62e-248c-4d17-8a25-081fbc677c86): created successfully
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b03b2c4-a4f9-4c5b-988b-2a21f5007e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:51 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Flow 'volume_create_manager' (eed6ca6b-dfd3-4e3c-8ab8-47e5de25b045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-34b8caa1-cbc1-47d5-bc1e-f33c89f61087 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Created volume successfully.
Sep 09 04:05:51 devstack sudo[103868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d
Sep 09 04:05:51 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:52 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d" returned: 0 in 0.401s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:52 devstack sudo[103873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8 1G
Sep 09 04:05:52 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "cinder-fd4aa62e-248c-4d17-8a25-081fbc677c86-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-fd4aa62e-248c-4d17-8a25-081fbc677c86-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:52 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8 1G" returned: 0 in 0.467s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6a9e1c5-ca23-4a63-a912-70421581784d -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:52 devstack sudo[103880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6a9e1c5-ca23-4a63-a912-70421581784d -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8
Sep 09 04:05:52 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "cinder-quobyte-fd4aa62e-248c-4d17-8a25-081fbc677c86" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-quobyte-fd4aa62e-248c-4d17-8a25-081fbc677c86" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:52 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c0bf36-1cf3-401a-bdea-0dfbf76b434d]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4aa62e-248c-4d17-8a25-081fbc677c86 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:52 devstack sudo[103882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4aa62e-248c-4d17-8a25-081fbc677c86
Sep 09 04:05:52 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:53 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6a9e1c5-ca23-4a63-a912-70421581784d -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8" returned: 0 in 0.320s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:53 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8 is being set with open permissions: ugo+rw
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:53 devstack sudo[103887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8
Sep 09 04:05:53 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:53 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4aa62e-248c-4d17-8a25-081fbc677c86" returned: 0 in 0.370s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4aa62e-248c-4d17-8a25-081fbc677c86 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:53 devstack sudo[103892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4aa62e-248c-4d17-8a25-081fbc677c86
Sep 09 04:05:53 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:53 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8" returned: 0 in 0.270s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:53 devstack sudo[103895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.info
Sep 09 04:05:53 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:53 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4aa62e-248c-4d17-8a25-081fbc677c86" returned: 0 in 0.277s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-quobyte-fd4aa62e-248c-4d17-8a25-081fbc677c86" released by "delete_volume" :: held 0.701s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Created reservations ['998c8abb-82c8-4aab-a59e-4262fd382881', '812c1108-a331-4263-9450-399814506cb3', '424a9102-8af4-4f1d-8dbe-426db69cfc89', '9f92574e-b403-41bf-a5de-1fe12fa60fd8'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:53 devstack sudo[103901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:53 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:53 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.info" returned: 0 in 0.329s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:53 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.info is being set with open permissions: ugo+rw
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:53 devstack sudo[103903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.info
Sep 09 04:05:53 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "cinder-2d54447f-ef0b-45e2-bde2-979047e0fa8a-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:53 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.343s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-2d54447f-ef0b-45e2-bde2-979047e0fa8a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:53 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Deleted volume successfully.
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2944244a-5ffb-4242-a9a1-0fce68e81869 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-fd4aa62e-248c-4d17-8a25-081fbc677c86-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "cinder-quobyte-2d54447f-ef0b-45e2-bde2-979047e0fa8a" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-quobyte-2d54447f-ef0b-45e2-bde2-979047e0fa8a" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6115773-e293-4ef3-9ff2-d13964d89fac]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:54 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.info" returned: 0 in 0.437s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:54 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-eff02100-21aa-42aa-826d-27128f30d6eb tempest-CinderUnicodeTest-1222434814 None] Create snapshot completed successfully
Sep 09 04:05:54 devstack sudo[103907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a
Sep 09 04:05:54 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "cinder-993b0c40-43d3-4b15-851e-61bc4b9f42b8-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-993b0c40-43d3-4b15-851e-61bc4b9f42b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "cinder-quobyte-b6a9e1c5-ca23-4a63-a912-70421581784d" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-quobyte-b6a9e1c5-ca23-4a63-a912-70421581784d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "cinder-quobyte-993b0c40-43d3-4b15-851e-61bc4b9f42b8" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-quobyte-993b0c40-43d3-4b15-851e-61bc4b9f42b8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Deleting offline snapshot 993b0c40-43d3-4b15-851e-61bc4b9f42b8 of volume b6a9e1c5-ca23-4a63-a912-70421581784d {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] snapshot_file for this snap is: volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7b92e4-b88b-4c23-b026-b073828a715e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:54 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a" returned: 0 in 0.405s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:54 devstack sudo[103913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a
Sep 09 04:05:54 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:54 devstack sudo[103912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8
Sep 09 04:05:54 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:54 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-2d54447f-ef0b-45e2-bde2-979047e0fa8a" returned: 0 in 0.288s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Flow 'volume_create_manager' (a426ae64-4dbd-43c6-b7f5-897dab6288f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2320fa4e-a0b2-40ba-b7d6-25127b3c2698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-quobyte-2d54447f-ef0b-45e2-bde2-979047e0fa8a" released by "delete_volume" :: held 0.779s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:54 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8" returned: 0 in 0.421s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6a9e1c5-ca23-4a63-a912-70421581784d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67f44f1-b462-42eb-87e8-60576a593bf8]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2320fa4e-a0b2-40ba-b7d6-25127b3c2698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2087508715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa781e8-2200-4765-8ed0-e95d788ca442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593aaa340449427dbefda017edfde8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:55Z,use_quota=True,user_id='015ffb7e51e34ef8bb266f7d7e66b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb53178-fdae-4605-9103-197d439a86e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb53178-fdae-4605-9103-197d439a86e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67314e3b-13b8-4b1e-b012-75abf75a49bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.image.glance [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Creating Keystone auth plugin from conf {{(pid=87558) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:54 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Created reservations ['2c1046f6-b62d-4879-a40e-0ee1ceb397b2', '9769698c-c9bb-4c07-b06e-20aa04c17986', '3282db12-7b93-40f0-a964-1ab63418c68d', 'd6b698aa-8a80-46a5-8511-65096e1e0fbc'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:55 devstack sudo[103920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d
Sep 09 04:05:55 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:55 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:55 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "cinder-f6d894a8-acaf-4c0b-abd2-492d8f019796-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-f6d894a8-acaf-4c0b-abd2-492d8f019796-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "cinder-quobyte-f6d894a8-acaf-4c0b-abd2-492d8f019796" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-quobyte-f6d894a8-acaf-4c0b-abd2-492d8f019796" acquired by "delete_volume" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67314e3b-13b8-4b1e-b012-75abf75a49bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5fa781e8-2200-4765-8ed0-e95d788ca442', 'volume_name': 'volume-5fa781e8-2200-4765-8ed0-e95d788ca442', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42b5e7d100>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c21d36-0d6a-4e5c-a2a0-581ec09d6b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c21d36-0d6a-4e5c-a2a0-581ec09d6b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e419cef8-239b-4c4d-92bd-b53f1f7f5e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:05:55 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Volume 5fa781e8-2200-4765-8ed0-e95d788ca442: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5fa781e8-2200-4765-8ed0-e95d788ca442', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42b5e7d100>}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Trying to clone 5fa781e8-2200-4765-8ed0-e95d788ca442 from image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]). {{(pid=87558) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aa40df-cc33-499f-900a-593e342f5012]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f6d894a8-acaf-4c0b-abd2-492d8f019796 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:55 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d" returned: 0 in 0.488s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:55 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:55 devstack sudo[103925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f6d894a8-acaf-4c0b-abd2-492d8f019796
Sep 09 04:05:55 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.362s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:55 devstack sudo[103931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8
Sep 09 04:05:55 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:55 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Deleted volume successfully.
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-338bc0b0-8ff5-4b49-981c-2c091f31d68e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-2d54447f-ef0b-45e2-bde2-979047e0fa8a-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 04:05:55 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Image download 20.69 MB at 20.69 MB/s
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[def21949-1ae8-4851-9f25-28001604d24b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:55 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f6d894a8-acaf-4c0b-abd2-492d8f019796" returned: 0 in 0.481s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f6d894a8-acaf-4c0b-abd2-492d8f019796 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:55 devstack sudo[103942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f6d894a8-acaf-4c0b-abd2-492d8f019796
Sep 09 04:05:55 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:55 devstack sudo[103939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD
Sep 09 04:05:55 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:55 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8" returned: 0 in 0.437s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:55 devstack sudo[103945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8
Sep 09 04:05:55 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:56 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f6d894a8-acaf-4c0b-abd2-492d8f019796" returned: 0 in 0.254s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:56 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-quobyte-f6d894a8-acaf-4c0b-abd2-492d8f019796" released by "delete_volume" :: held 0.796s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Temporary image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 is fetched for user 015ffb7e51e34ef8bb266f7d7e66b246. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Created reservations ['254afca3-781b-4525-8972-ad86c2249b5a', '3cef1575-ef12-4737-aae1-4ba064511818', '778823a8-459e-47a7-8860-4e968f4f3949', 'dfcaf239-e049-41fb-9fb5-554b07a23387'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f1bd2a-6a3e-4004-9786-8affa999c7e5]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:56 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d.993b0c40-43d3-4b15-851e-61bc4b9f42b8" returned: 0 in 0.281s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-quobyte-993b0c40-43d3-4b15-851e-61bc4b9f42b8" released by "_delete_snapshot" :: held 1.782s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-quobyte-b6a9e1c5-ca23-4a63-a912-70421581784d" released by "delete_snapshot" :: held 1.809s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:56 devstack sudo[103952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD
Sep 09 04:05:56 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:56 devstack sudo[103953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:56 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Created reservations ['e16fd6cf-5f69-440f-9d82-1330174b7db5', '582d26f0-7a09-4d7e-9802-c80f371b8024', '9c4277d5-de5a-4280-a89c-21f4cc03f73e', 'c713816e-5e6a-4a35-b7cd-73b09a04c555'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "cinder-a02e5cc7-4a3d-4e73-a726-a68f393b708f-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-a02e5cc7-4a3d-4e73-a726-a68f393b708f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:56 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Delete snapshot completed successfully.
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a5eb8477-810b-48b6-abb3-c6d722712fdc tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-993b0c40-43d3-4b15-851e-61bc4b9f42b8-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "cinder-quobyte-a02e5cc7-4a3d-4e73-a726-a68f393b708f" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-quobyte-a02e5cc7-4a3d-4e73-a726-a68f393b708f" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:56 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2087508715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa781e8-2200-4765-8ed0-e95d788ca442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593aaa340449427dbefda017edfde8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:05:55Z,use_quota=True,user_id='015ffb7e51e34ef8bb266f7d7e66b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Creating volume 5fa781e8-2200-4765-8ed0-e95d788ca442 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:05:56 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[09491f2b-f175-411e-b2b7-9680df50d8b0]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:56 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:56 devstack sudo[103961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 1073741824
Sep 09 04:05:56 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.328s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "cinder-b6a9e1c5-ca23-4a63-a912-70421581784d-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:56 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Deleted volume successfully.
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-b6a9e1c5-ca23-4a63-a912-70421581784d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-91451188-f8da-455b-840f-45d0b86b7f1e tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-f6d894a8-acaf-4c0b-abd2-492d8f019796-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "cinder-quobyte-b6a9e1c5-ca23-4a63-a912-70421581784d" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-quobyte-b6a9e1c5-ca23-4a63-a912-70421581784d" acquired by "delete_volume" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:56 devstack sudo[103962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f
Sep 09 04:05:56 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c84db59-f773-4bb9-a58c-ace08e836ce1]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:56 devstack sudo[103965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d
Sep 09 04:05:56 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:56 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f" returned: 0 in 0.425s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:56 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 1073741824" returned: 0 in 0.453s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:57 devstack sudo[103974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f
Sep 09 04:05:57 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:57 devstack sudo[103976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442
Sep 09 04:05:57 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:57 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d" returned: 0 in 0.400s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:57 devstack sudo[103981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d
Sep 09 04:05:57 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:57 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a02e5cc7-4a3d-4e73-a726-a68f393b708f" returned: 0 in 0.249s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-quobyte-a02e5cc7-4a3d-4e73-a726-a68f393b708f" released by "delete_volume" :: held 0.749s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:57 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442" returned: 0 in 0.256s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Created reservations ['77e9bd6b-72b8-4823-9c61-7df9a12e659d', 'c7d8afe2-4087-4f04-b231-bc5c809d5d8f', '732f4bcb-86e0-4842-a103-f311d297df7e', 'e5caf591-a6dd-43fb-8857-611336a2049b'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Attempting download of 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}])) to volume 5fa781e8-2200-4765-8ed0-e95d788ca442. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e327c8-9790-48ac-8893-4c376e6fb2ac]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_9jz9r84p {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:57 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b6a9e1c5-ca23-4a63-a912-70421581784d" returned: 0 in 0.284s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-quobyte-b6a9e1c5-ca23-4a63-a912-70421581784d" released by "delete_volume" :: held 0.747s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:57 devstack sudo[103987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:57 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Created reservations ['89ab93a1-04d9-42d2-83ae-b034c5ae6028', 'f9aaa765-93ce-46d6-a170-5edc1789d201', 'bc6ecfdf-b189-4c08-814a-1ab859b9ba4e', 'ab07f62b-f3d3-44d5-92c0-0f8d7da8c833'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:57 devstack sudo[103986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_9jz9r84p
Sep 09 04:05:57 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "cinder-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:57 devstack sudo[103990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:57 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "cinder-quobyte-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:57 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-quobyte-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.312s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:57 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Deleted volume successfully.
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6d8fc5-3d0b-4bea-85fb-a86ff1f0bd45]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:57 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_9jz9r84p" returned: 0 in 0.395s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_9jz9r84p {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-98192793-776c-4ce3-b0a4-25ba386f0e77 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-a02e5cc7-4a3d-4e73-a726-a68f393b708f-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "cinder-01925546-d511-43b8-8c8b-2469b906787d-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-01925546-d511-43b8-8c8b-2469b906787d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "cinder-quobyte-01925546-d511-43b8-8c8b-2469b906787d" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-quobyte-01925546-d511-43b8-8c8b-2469b906787d" acquired by "delete_volume" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:57 devstack sudo[103995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421
Sep 09 04:05:57 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce57362-8163-4d1a-b325-027b5938f96a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-01925546-d511-43b8-8c8b-2469b906787d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:57 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.385s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:57 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:57 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Deleted volume successfully.
Sep 09 04:05:57 devstack sudo[103996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_9jz9r84p
Sep 09 04:05:57 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ec3224ad-3f8f-4830-a1c1-ccff46d81297 tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-b6a9e1c5-ca23-4a63-a912-70421581784d-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:58 devstack sudo[103999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-01925546-d511-43b8-8c8b-2469b906787d
Sep 09 04:05:58 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:58 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421" returned: 0 in 0.461s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:58 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_9jz9r84p" returned: 1 in 0.448s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_9jz9r84p' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f743ea-8b81-461c-9272-4222da84cf33]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:58 devstack sudo[104007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421
Sep 09 04:05:58 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:58 devstack sudo[104008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD
Sep 09 04:05:58 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:58 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-01925546-d511-43b8-8c8b-2469b906787d" returned: 0 in 0.411s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-01925546-d511-43b8-8c8b-2469b906787d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:58 devstack sudo[104014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-01925546-d511-43b8-8c8b-2469b906787d
Sep 09 04:05:58 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:58 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421" returned: 0 in 0.267s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-quobyte-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421" released by "delete_volume" :: held 0.793s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Created reservations ['d409b7dc-f36e-40f2-b196-0ec6f7fbb319', '5ad93d5e-7f20-4fa2-95f8-76beacdd8885', '173e66d3-0825-49ae-bca4-2a4ae22f1d56', '45541271-5e19-48ee-92ec-bcb5b0230142'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:58 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 was qcow2, converting to qcow2 {{(pid=87558) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:58 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-01925546-d511-43b8-8c8b-2469b906787d" returned: 0 in 0.264s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:58 devstack sudo[104021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442
Sep 09 04:05:58 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-quobyte-01925546-d511-43b8-8c8b-2469b906787d" released by "delete_volume" :: held 0.749s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:58 devstack sudo[104023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:58 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Created reservations ['20001df6-4407-4df4-9f1b-b4a00798a705', '02329670-8c9e-4cdf-8fbb-84c263657edf', '8591d18c-4313-4a2d-ab1a-fa2a4721d7a6', '1cb78dea-d09f-41c5-8b40-ba1c9bc93162'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "cinder-cbb4cc51-ad9e-4976-9530-670f43b99b80-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:58 devstack sudo[104025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:05:58 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-cbb4cc51-ad9e-4976-9530-670f43b99b80-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:58 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.333s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "cinder-quobyte-cbb4cc51-ad9e-4976-9530-670f43b99b80" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:05:58 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Deleted volume successfully.
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-quobyte-cbb4cc51-ad9e-4976-9530-670f43b99b80" acquired by "delete_volume" :: waited 0.042s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29f068e-3a82-4026-88f5-2d37273bbbae]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbb4cc51-ad9e-4976-9530-670f43b99b80 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e0db7a3c-64f5-4499-bd70-a16674f13a11 tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-e00ff99f-4601-4e73-9ac9-d2b7ff2d3421-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:59 devstack sudo[104032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbb4cc51-ad9e-4976-9530-670f43b99b80
Sep 09 04:05:59 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:59 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.412s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:05:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Deleted volume successfully.
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-474efb1f-4826-4913-8ec4-43f2e374f0eb tempest-CinderUnicodeTest-1222434814 None] Lock "cinder-01925546-d511-43b8-8c8b-2469b906787d-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:59 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbb4cc51-ad9e-4976-9530-670f43b99b80" returned: 0 in 0.430s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbb4cc51-ad9e-4976-9530-670f43b99b80 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:05:59 devstack sudo[104043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbb4cc51-ad9e-4976-9530-670f43b99b80
Sep 09 04:05:59 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:05:59 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cbb4cc51-ad9e-4976-9530-670f43b99b80" returned: 0 in 0.306s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-quobyte-cbb4cc51-ad9e-4976-9530-670f43b99b80" released by "delete_volume" :: held 0.786s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Created reservations ['de3a25ac-e01c-424f-b741-31d913859034', '2f3cca63-ab73-4717-aed8-d2f338104898', '205b1a4b-edae-4002-8cb6-71b8de40b40c', 'f85ea54c-2121-44a0-8f6e-651647c6da08'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:05:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:00 devstack sudo[104046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:06:00 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:00 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.339s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:00 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:06:00 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Deleted volume successfully.
Sep 09 04:06:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-229d767a-997f-4721-8934-295528d5c14b tempest-CreateVolumesFromSourceVolumeTest-1686618691 None] Lock "cinder-cbb4cc51-ad9e-4976-9530-670f43b99b80-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:00 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442" returned: 0 in 2.133s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:00 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92_kd24p6zydevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 04:06:00 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Converted 112.00 MB image at 52.47 MB/s
Sep 09 04:06:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:00 devstack sudo[104049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 1G
Sep 09 04:06:00 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:01 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 1G" returned: 0 in 0.457s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:01 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Downloaded image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}])) to volume 5fa781e8-2200-4765-8ed0-e95d788ca442 successfully. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 04:06:01 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Temporary image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 for user 015ffb7e51e34ef8bb266f7d7e66b246 is deleted. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 04:06:01 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Marking volume 5fa781e8-2200-4765-8ed0-e95d788ca442 as bootable. {{(pid=87558) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 04:06:01 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Copying metadata from image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 to 5fa781e8-2200-4765-8ed0-e95d788ca442. {{(pid=87558) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 04:06:01 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Creating volume glance metadata for volume 5fa781e8-2200-4765-8ed0-e95d788ca442 backed by image 6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87558) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 04:06:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e419cef8-239b-4c4d-92bd-b53f1f7f5e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa781e8-2200-4765-8ed0-e95d788ca442', 'volume_size': 1, 'image_id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375a805d0d4042308c74bb5f89670b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92', 'created_at': datetime.datetime(2026, 9, 9, 1, 44, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 44, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dbccb4c-8bec-40b1-8e2b-1cbc2e283a92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42b5e7d100>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814b4caa-67a6-4a2c-ad37-999f3a228210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:01 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Volume volume-5fa781e8-2200-4765-8ed0-e95d788ca442 (5fa781e8-2200-4765-8ed0-e95d788ca442): created successfully
Sep 09 04:06:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814b4caa-67a6-4a2c-ad37-999f3a228210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Flow 'volume_create_manager' (a426ae64-4dbd-43c6-b7f5-897dab6288f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:01 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-fcfff670-9b58-4224-b9ee-071488f51746 tempest-VolumesExtendTest-456470276 None] Created volume successfully.
Sep 09 04:06:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-37bd352c-42ba-4795-abdd-2b23776e2bf2 tempest-VolumesExtendTest-456470276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-37bd352c-42ba-4795-abdd-2b23776e2bf2 tempest-VolumesExtendTest-456470276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:02 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2fb4b0-c7e6-470e-8f46-8c3855ab720e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-37bd352c-42ba-4795-abdd-2b23776e2bf2 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:02 devstack sudo[104056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442
Sep 09 04:06:02 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:02 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-37bd352c-42ba-4795-abdd-2b23776e2bf2 tempest-VolumesExtendTest-456470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442" returned: 0 in 0.368s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-37bd352c-42ba-4795-abdd-2b23776e2bf2 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 2G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-37bd352c-42ba-4795-abdd-2b23776e2bf2 tempest-VolumesExtendTest-456470276 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 2G" returned: 0 in 0.102s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-37bd352c-42ba-4795-abdd-2b23776e2bf2 tempest-VolumesExtendTest-456470276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.501s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:02 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-37bd352c-42ba-4795-abdd-2b23776e2bf2 tempest-VolumesExtendTest-456470276 None] Extend volume completed successfully.
Sep 09 04:06:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Acquiring lock "cinder-5fa781e8-2200-4765-8ed0-e95d788ca442-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Lock "cinder-5fa781e8-2200-4765-8ed0-e95d788ca442-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Acquiring lock "cinder-quobyte-5fa781e8-2200-4765-8ed0-e95d788ca442" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Lock "cinder-quobyte-5fa781e8-2200-4765-8ed0-e95d788ca442" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:03 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8789c4-b13d-4cab-8470-630e7e9412a0]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:04 devstack sudo[104065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442
Sep 09 04:06:04 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:04 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442" returned: 0 in 0.371s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:04 devstack sudo[104071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442
Sep 09 04:06:04 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:04 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5fa781e8-2200-4765-8ed0-e95d788ca442" returned: 0 in 0.260s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Lock "cinder-quobyte-5fa781e8-2200-4765-8ed0-e95d788ca442" released by "delete_volume" :: held 0.672s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:04 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Created reservations ['0fa472a7-b143-4a80-8135-a04bf5e6efb4', '4fc1de93-594b-4c82-bc14-8b01917d33d9', 'ddcefb4c-f351-4ca7-9294-449e57d45980', '686a0f89-455b-4a73-aee7-b12fb66d4787'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:06:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:04 devstack sudo[104074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:06:04 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:05 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.304s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:06:05 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Deleted volume successfully.
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c29d62aa-b21b-41bf-890f-0f3ed4030d0b tempest-VolumesExtendTest-456470276 None] Lock "cinder-5fa781e8-2200-4765-8ed0-e95d788ca442-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Flow 'volume_create_manager' (415d1559-3f94-47d2-94dc-a6d4e8aabba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ca5168-92cd-4b62-8a5c-158a65c43f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ca5168-92cd-4b62-8a5c-158a65c43f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-847660922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d8ad75-6719-4b80-8b32-12738ba61207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593aaa340449427dbefda017edfde8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:05Z,use_quota=True,user_id='015ffb7e51e34ef8bb266f7d7e66b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff272d9-2244-45b1-8570-0e693d1925ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff272d9-2244-45b1-8570-0e693d1925ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e6e375-11eb-4030-8b31-5d5c2141c19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e6e375-11eb-4030-8b31-5d5c2141c19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d8ad75-6719-4b80-8b32-12738ba61207', 'volume_name': 'volume-57d8ad75-6719-4b80-8b32-12738ba61207', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45832fc2-45d6-4368-8660-2b94ba52fa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45832fc2-45d6-4368-8660-2b94ba52fa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114c7ca0-21ec-42c4-a759-868522b5f17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:05 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Volume 57d8ad75-6719-4b80-8b32-12738ba61207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d8ad75-6719-4b80-8b32-12738ba61207', 'volume_size': 1}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-847660922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d8ad75-6719-4b80-8b32-12738ba61207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593aaa340449427dbefda017edfde8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:05Z,use_quota=True,user_id='015ffb7e51e34ef8bb266f7d7e66b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Creating volume 57d8ad75-6719-4b80-8b32-12738ba61207 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:06:05 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:05 devstack sudo[104078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207 1073741824
Sep 09 04:06:05 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:05 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207 1073741824" returned: 0 in 0.421s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:06 devstack sudo[104084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207
Sep 09 04:06:06 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:06 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207" returned: 0 in 0.254s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:06:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114c7ca0-21ec-42c4-a759-868522b5f17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d8ad75-6719-4b80-8b32-12738ba61207', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f54a9d-fff7-4294-8c9f-8810a0c255f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:06 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Volume volume-57d8ad75-6719-4b80-8b32-12738ba61207 (57d8ad75-6719-4b80-8b32-12738ba61207): created successfully
Sep 09 04:06:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f54a9d-fff7-4294-8c9f-8810a0c255f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:06 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Flow 'volume_create_manager' (415d1559-3f94-47d2-94dc-a6d4e8aabba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:06 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-796ca681-1a26-48bf-8e2d-cfd23a7a7194 tempest-VolumesExtendTest-456470276 None] Created volume successfully.
Sep 09 04:06:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] Creating offline snapshot bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 of volume 57d8ad75-6719-4b80-8b32-12738ba61207 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:06:06 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c12dc9a-b9a4-410c-91fe-f7b267abcf19]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:06 devstack sudo[104087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207
Sep 09 04:06:06 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:07 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207" returned: 0 in 0.368s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:07 devstack sudo[104092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 1G
Sep 09 04:06:07 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:07 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 1G" returned: 0 in 0.425s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d8ad75-6719-4b80-8b32-12738ba61207 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:07 devstack sudo[104098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d8ad75-6719-4b80-8b32-12738ba61207 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403
Sep 09 04:06:07 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Flow 'volume_create_manager' (6295ae45-11c0-4540-a773-6b42970b2a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4730e7-9e6b-4a92-b083-b21dbbf9163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4730e7-9e6b-4a92-b083-b21dbbf9163d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-360909894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff4de6d-c900-439e-9519-e44063ae0337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b88c5c3148425f8253bd8aca84e273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:08Z,use_quota=True,user_id='18e2ceec0e444e1e9745d69fd5ad82ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d2b04a-5534-4992-910a-0a607e15c1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d2b04a-5534-4992-910a-0a607e15c1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20e45c6-28c1-4849-88f9-f3eedb1ec8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20e45c6-28c1-4849-88f9-f3eedb1ec8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff4de6d-c900-439e-9519-e44063ae0337', 'volume_name': 'volume-cff4de6d-c900-439e-9519-e44063ae0337', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2f9a9f-f19e-4861-b68f-01ca5328877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2f9a9f-f19e-4861-b68f-01ca5328877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd01453-f01d-47c2-9787-3ee7d57ef448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:07 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Volume cff4de6d-c900-439e-9519-e44063ae0337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff4de6d-c900-439e-9519-e44063ae0337', 'volume_size': 1}
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:07 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d8ad75-6719-4b80-8b32-12738ba61207 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403" returned: 0 in 0.307s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:07 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 is being set with open permissions: ugo+rw
Sep 09 04:06:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:07 devstack sudo[104103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403
Sep 09 04:06:07 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:08 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403" returned: 0 in 0.232s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:08 devstack sudo[104106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.info
Sep 09 04:06:08 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:08 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.info" returned: 0 in 0.250s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:08 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.info is being set with open permissions: ugo+rw
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:08 devstack sudo[104109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.info
Sep 09 04:06:08 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:08 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.info" returned: 0 in 0.236s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.917s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-360909894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff4de6d-c900-439e-9519-e44063ae0337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b88c5c3148425f8253bd8aca84e273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:08Z,use_quota=True,user_id='18e2ceec0e444e1e9745d69fd5ad82ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Creating volume cff4de6d-c900-439e-9519-e44063ae0337 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:06:08 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cff4de6d-c900-439e-9519-e44063ae0337 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:08 devstack sudo[104146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cff4de6d-c900-439e-9519-e44063ae0337 1073741824
Sep 09 04:06:08 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:08 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c5d12179-2b8f-4eca-9f93-0361667e74da tempest-VolumesExtendTest-456470276 None] Create snapshot completed successfully
Sep 09 04:06:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8149dab9-5c06-41a0-b65c-8d99e7c03536 tempest-VolumesExtendTest-456470276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:09 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cff4de6d-c900-439e-9519-e44063ae0337 1073741824" returned: 0 in 0.462s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cff4de6d-c900-439e-9519-e44063ae0337 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:09 devstack sudo[104154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cff4de6d-c900-439e-9519-e44063ae0337
Sep 09 04:06:09 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:09 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cff4de6d-c900-439e-9519-e44063ae0337" returned: 0 in 0.235s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8149dab9-5c06-41a0-b65c-8d99e7c03536 tempest-VolumesExtendTest-456470276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.433s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd01453-f01d-47c2-9787-3ee7d57ef448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff4de6d-c900-439e-9519-e44063ae0337', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f3f4ff-ddd7-48f9-bb25-578a944d28ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1787257b-a9df-4075-bebf-92dec4e69f98]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8149dab9-5c06-41a0-b65c-8d99e7c03536 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:09 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Volume volume-cff4de6d-c900-439e-9519-e44063ae0337 (cff4de6d-c900-439e-9519-e44063ae0337): created successfully
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f3f4ff-ddd7-48f9-bb25-578a944d28ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Flow 'volume_create_manager' (6295ae45-11c0-4540-a773-6b42970b2a1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:09 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b3ee42cc-daa8-4b6e-9d01-474d2f37d667 tempest-ProjectReaderTests-2086815997 None] Created volume successfully.
Sep 09 04:06:09 devstack sudo[104157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207
Sep 09 04:06:09 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:09 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8149dab9-5c06-41a0-b65c-8d99e7c03536 tempest-VolumesExtendTest-456470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207" returned: 0 in 0.353s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8149dab9-5c06-41a0-b65c-8d99e7c03536 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 2G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Acquiring lock "cinder-cff4de6d-c900-439e-9519-e44063ae0337-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Lock "cinder-cff4de6d-c900-439e-9519-e44063ae0337-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Acquiring lock "cinder-quobyte-cff4de6d-c900-439e-9519-e44063ae0337" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Lock "cinder-quobyte-cff4de6d-c900-439e-9519-e44063ae0337" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8149dab9-5c06-41a0-b65c-8d99e7c03536 tempest-VolumesExtendTest-456470276 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 2G" returned: 0 in 0.151s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8149dab9-5c06-41a0-b65c-8d99e7c03536 tempest-VolumesExtendTest-456470276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.549s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c03cf6-aca1-42fc-96b8-baf6f6491bd6]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cff4de6d-c900-439e-9519-e44063ae0337 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:09 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8149dab9-5c06-41a0-b65c-8d99e7c03536 tempest-VolumesExtendTest-456470276 None] Extend volume completed successfully.
Sep 09 04:06:09 devstack sudo[104166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cff4de6d-c900-439e-9519-e44063ae0337
Sep 09 04:06:09 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Acquiring lock "cinder-bc59cbef-1f6d-4a64-a96a-5e0d1be1a403-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Lock "cinder-bc59cbef-1f6d-4a64-a96a-5e0d1be1a403-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Acquiring lock "cinder-quobyte-57d8ad75-6719-4b80-8b32-12738ba61207" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Lock "cinder-quobyte-57d8ad75-6719-4b80-8b32-12738ba61207" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Acquiring lock "cinder-quobyte-bc59cbef-1f6d-4a64-a96a-5e0d1be1a403" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Lock "cinder-quobyte-bc59cbef-1f6d-4a64-a96a-5e0d1be1a403" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Deleting offline snapshot bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 of volume 57d8ad75-6719-4b80-8b32-12738ba61207 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] snapshot_file for this snap is: volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9ba8a9-8353-418b-8918-47c1a583c0e2]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:10 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cff4de6d-c900-439e-9519-e44063ae0337" returned: 0 in 0.376s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cff4de6d-c900-439e-9519-e44063ae0337 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:10 devstack sudo[104172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cff4de6d-c900-439e-9519-e44063ae0337
Sep 09 04:06:10 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:10 devstack sudo[104171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403
Sep 09 04:06:10 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:10 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-cff4de6d-c900-439e-9519-e44063ae0337" returned: 0 in 0.246s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Lock "cinder-quobyte-cff4de6d-c900-439e-9519-e44063ae0337" released by "delete_volume" :: held 0.658s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Created reservations ['5b5ff9b4-80ec-44be-996d-24cec623621d', '28f9a051-93b1-4220-94a7-53bd2bfd62af', '8c0089ae-e14c-4963-9214-7dd4a93719eb', '070c5061-8b8f-405f-85a1-f0f4b4772464'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:06:10 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403" returned: 0 in 0.383s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57d8ad75-6719-4b80-8b32-12738ba61207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac320c6d-e974-4b14-86d1-1b9f748294bd]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:10 devstack sudo[104181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:06:10 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:10 devstack sudo[104180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207
Sep 09 04:06:10 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:10 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.255s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:06:10 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Deleted volume successfully.
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2ef6a270-6a15-4c94-8a5f-1c223a96b74d tempest-ProjectReaderTests-2086815997 None] Lock "cinder-cff4de6d-c900-439e-9519-e44063ae0337-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:10 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207" returned: 0 in 0.390s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:11 devstack sudo[104188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403
Sep 09 04:06:11 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:11 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403" returned: 0 in 0.396s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:06:11 devstack sudo[104194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403
Sep 09 04:06:11 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Flow 'volume_create_manager' (1b9ee4b2-85af-4292-8fa5-82023013af64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08bb730-d164-4e2b-b6c9-9e70efdf180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08bb730-d164-4e2b-b6c9-9e70efdf180c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-219529030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c879d6f4-d54d-4d9a-ac18-47b9a11ac479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b88c5c3148425f8253bd8aca84e273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:11Z,use_quota=True,user_id='18e2ceec0e444e1e9745d69fd5ad82ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efb6d1b-4260-45ea-941f-7f2ac3d87d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efb6d1b-4260-45ea-941f-7f2ac3d87d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a01bbf-843c-4497-97b4-fb310ca39d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a01bbf-843c-4497-97b4-fb310ca39d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c879d6f4-d54d-4d9a-ac18-47b9a11ac479', 'volume_name': 'volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d1f76d-a64f-466b-9aa5-116aff8073c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d1f76d-a64f-466b-9aa5-116aff8073c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad39b4a-d909-4bc5-88b6-bc528efeb228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:11 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Volume c879d6f4-d54d-4d9a-ac18-47b9a11ac479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479', 'volume_size': 1}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-219529030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c879d6f4-d54d-4d9a-ac18-47b9a11ac479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b88c5c3148425f8253bd8aca84e273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:11Z,use_quota=True,user_id='18e2ceec0e444e1e9745d69fd5ad82ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Creating volume c879d6f4-d54d-4d9a-ac18-47b9a11ac479 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:06:11 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:11 devstack sudo[104196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479 1073741824
Sep 09 04:06:11 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:11 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207.bc59cbef-1f6d-4a64-a96a-5e0d1be1a403" returned: 0 in 0.255s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Lock "cinder-quobyte-bc59cbef-1f6d-4a64-a96a-5e0d1be1a403" released by "_delete_snapshot" :: held 1.533s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Lock "cinder-quobyte-57d8ad75-6719-4b80-8b32-12738ba61207" released by "delete_snapshot" :: held 1.559s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Created reservations ['2f7d9958-2d0c-4949-9ae3-e7e938311b1f', '8b3f529c-7269-4063-bca4-3b833a98b7c4', '32baa434-3a72-49d7-b61e-05451d319d39', '76000e8c-3886-4642-96ca-8f742d6d6a6b'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:06:11 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Delete snapshot completed successfully.
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3ec7bb01-0432-4792-b229-1d7d19c5464b tempest-VolumesExtendTest-456470276 None] Lock "cinder-bc59cbef-1f6d-4a64-a96a-5e0d1be1a403-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:11 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479 1073741824" returned: 0 in 0.447s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:12 devstack sudo[104203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479
Sep 09 04:06:12 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:12 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479" returned: 0 in 0.265s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad39b4a-d909-4bc5-88b6-bc528efeb228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b3166c-8a00-45fd-8f11-1177b55e08b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:12 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Volume volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479 (c879d6f4-d54d-4d9a-ac18-47b9a11ac479): created successfully
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b3166c-8a00-45fd-8f11-1177b55e08b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Flow 'volume_create_manager' (1b9ee4b2-85af-4292-8fa5-82023013af64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:12 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7bffc85e-c4cb-4ebf-bda3-203350c91257 tempest-ProjectReaderTests-2086815997 None] Created volume successfully.
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Acquiring lock "cinder-57d8ad75-6719-4b80-8b32-12738ba61207-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Lock "cinder-57d8ad75-6719-4b80-8b32-12738ba61207-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Acquiring lock "cinder-quobyte-57d8ad75-6719-4b80-8b32-12738ba61207" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Lock "cinder-quobyte-57d8ad75-6719-4b80-8b32-12738ba61207" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc40e54-61b3-42bd-9ec6-7ab629d2f465]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Acquiring lock "cinder-c879d6f4-d54d-4d9a-ac18-47b9a11ac479-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Lock "cinder-c879d6f4-d54d-4d9a-ac18-47b9a11ac479-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Acquiring lock "cinder-quobyte-c879d6f4-d54d-4d9a-ac18-47b9a11ac479" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Lock "cinder-quobyte-c879d6f4-d54d-4d9a-ac18-47b9a11ac479" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:12 devstack sudo[104206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207
Sep 09 04:06:12 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42a83cb-0014-443c-b5fc-d1a2fd7c33b4]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:12 devstack sudo[104208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479
Sep 09 04:06:12 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:12 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207" returned: 0 in 0.384s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:12 devstack sudo[104213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207
Sep 09 04:06:12 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:12 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479" returned: 0 in 0.369s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:13 devstack sudo[104218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479
Sep 09 04:06:13 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:13 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-57d8ad75-6719-4b80-8b32-12738ba61207" returned: 0 in 0.247s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Lock "cinder-quobyte-57d8ad75-6719-4b80-8b32-12738ba61207" released by "delete_volume" :: held 0.687s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Created reservations ['ce232c18-3f39-4d33-800c-54ab5ace253c', '6b609237-f4df-4b57-8f3c-67cc19c7b09b', 'da1bae89-4533-4f14-b0cc-9acab07137b0', '08da2f76-5bf1-4c68-a9eb-8934b0b871b0'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:06:13 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c879d6f4-d54d-4d9a-ac18-47b9a11ac479" returned: 0 in 0.246s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Lock "cinder-quobyte-c879d6f4-d54d-4d9a-ac18-47b9a11ac479" released by "delete_volume" :: held 0.660s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:13 devstack sudo[104222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:06:13 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Created reservations ['d6b4fb6f-8c5f-4e9e-8d48-da8e66404f7d', '2d1df86a-0793-494d-8e21-6b3aa4faa412', '6ce13eaa-f23a-4f7d-94ce-3155d917c10b', 'db7efd09-16e4-48da-8ed6-35b76280f626'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:13 devstack sudo[104224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:06:13 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:13 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.264s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:06:13 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Deleted volume successfully.
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0271582e-ffb1-4098-adf5-2a9522529d96 tempest-VolumesExtendTest-456470276 None] Lock "cinder-57d8ad75-6719-4b80-8b32-12738ba61207-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:13 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.288s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:06:13 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Deleted volume successfully.
Sep 09 04:06:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9b2840e1-dfa4-4cbe-8d51-31c39ea81ae6 tempest-ProjectReaderTests-2086815997 None] Lock "cinder-c879d6f4-d54d-4d9a-ac18-47b9a11ac479-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Flow 'volume_create_manager' (41845cdf-093a-41bf-a7a3-5eb708dcf1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c1332b-7c0d-46d0-8bc5-d80714f8fc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c1332b-7c0d-46d0-8bc5-d80714f8fc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1034566641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edfdca34-902e-460b-9b45-99c7b4f59935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b88c5c3148425f8253bd8aca84e273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:14Z,use_quota=True,user_id='18e2ceec0e444e1e9745d69fd5ad82ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a66514-56f6-44db-a1db-80ce2695373c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a66514-56f6-44db-a1db-80ce2695373c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e0c5c0-40c8-4a28-a025-6289fb18f6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e0c5c0-40c8-4a28-a025-6289fb18f6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edfdca34-902e-460b-9b45-99c7b4f59935', 'volume_name': 'volume-edfdca34-902e-460b-9b45-99c7b4f59935', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb016b5-ac7a-4ba2-8625-7cdd9c3f3a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb016b5-ac7a-4ba2-8625-7cdd9c3f3a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d9649b-77c6-4abb-8e61-c4cbb40f66f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:14 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Volume edfdca34-902e-460b-9b45-99c7b4f59935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edfdca34-902e-460b-9b45-99c7b4f59935', 'volume_size': 1}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1034566641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edfdca34-902e-460b-9b45-99c7b4f59935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b88c5c3148425f8253bd8aca84e273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:14Z,use_quota=True,user_id='18e2ceec0e444e1e9745d69fd5ad82ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Creating volume edfdca34-902e-460b-9b45-99c7b4f59935 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:06:14 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-edfdca34-902e-460b-9b45-99c7b4f59935 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:14 devstack sudo[104228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-edfdca34-902e-460b-9b45-99c7b4f59935 1073741824
Sep 09 04:06:14 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:14 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-edfdca34-902e-460b-9b45-99c7b4f59935 1073741824" returned: 0 in 0.531s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-edfdca34-902e-460b-9b45-99c7b4f59935 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:14 devstack sudo[104234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-edfdca34-902e-460b-9b45-99c7b4f59935
Sep 09 04:06:14 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:15 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-edfdca34-902e-460b-9b45-99c7b4f59935" returned: 0 in 0.288s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:15 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:06:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d9649b-77c6-4abb-8e61-c4cbb40f66f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edfdca34-902e-460b-9b45-99c7b4f59935', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d925fbec-e1a0-4429-835f-fcf11193b215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:15 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Volume volume-edfdca34-902e-460b-9b45-99c7b4f59935 (edfdca34-902e-460b-9b45-99c7b4f59935): created successfully
Sep 09 04:06:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d925fbec-e1a0-4429-835f-fcf11193b215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:15 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Flow 'volume_create_manager' (41845cdf-093a-41bf-a7a3-5eb708dcf1c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:15 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0d250fea-2f41-4e30-a51f-10afee2a9d68 tempest-ProjectReaderTests-2086815997 None] Created volume successfully.
Sep 09 04:06:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Acquiring lock "cinder-edfdca34-902e-460b-9b45-99c7b4f59935-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Lock "cinder-edfdca34-902e-460b-9b45-99c7b4f59935-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Acquiring lock "cinder-quobyte-edfdca34-902e-460b-9b45-99c7b4f59935" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Lock "cinder-quobyte-edfdca34-902e-460b-9b45-99c7b4f59935" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:16 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[834f0180-9b2b-4e57-a15a-26756283bff2]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-edfdca34-902e-460b-9b45-99c7b4f59935 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:16 devstack sudo[104238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-edfdca34-902e-460b-9b45-99c7b4f59935
Sep 09 04:06:16 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:16 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-edfdca34-902e-460b-9b45-99c7b4f59935" returned: 0 in 0.372s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-edfdca34-902e-460b-9b45-99c7b4f59935 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:16 devstack sudo[104243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-edfdca34-902e-460b-9b45-99c7b4f59935
Sep 09 04:06:16 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:17 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-edfdca34-902e-460b-9b45-99c7b4f59935" returned: 0 in 0.279s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Lock "cinder-quobyte-edfdca34-902e-460b-9b45-99c7b4f59935" released by "delete_volume" :: held 0.697s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Created reservations ['f8e512e9-08d9-4fb5-90b9-e219c7702f7f', '2e59fd8f-b82a-4e83-841d-4b941967063f', 'bbd3fd39-9ad7-405b-8b3f-a66211de1a82', '0102abad-e86e-4767-a1e4-453c3f7ced4d'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:17 devstack sudo[104246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:06:17 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Flow 'volume_create_manager' (f83f6a5a-81ee-4d67-ae2e-08459e525480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15084f4c-e75e-4f42-9bed-591c3763cd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15084f4c-e75e-4f42-9bed-591c3763cd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-203362242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fbe876-caa8-457d-a3e8-3392d66789c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4119adf217e4a4ab72936fff44dfcd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:17Z,use_quota=True,user_id='e474d1fd61a04e7f9856e35a1a4f670c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d32fc5-8a42-4704-bf17-e58a105e16e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d32fc5-8a42-4704-bf17-e58a105e16e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3da6fc-3d10-4239-a633-d20864f4ddf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3da6fc-3d10-4239-a633-d20864f4ddf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78fbe876-caa8-457d-a3e8-3392d66789c6', 'volume_name': 'volume-78fbe876-caa8-457d-a3e8-3392d66789c6', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b382c3ae-62d0-4681-a1f8-ad98ad761f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b382c3ae-62d0-4681-a1f8-ad98ad761f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027ee95b-e3d2-4804-b212-c93ef197d8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:17 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Volume 78fbe876-caa8-457d-a3e8-3392d66789c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78fbe876-caa8-457d-a3e8-3392d66789c6', 'volume_size': 1}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-203362242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fbe876-caa8-457d-a3e8-3392d66789c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4119adf217e4a4ab72936fff44dfcd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:17Z,use_quota=True,user_id='e474d1fd61a04e7f9856e35a1a4f670c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Creating volume 78fbe876-caa8-457d-a3e8-3392d66789c6 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:06:17 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:17 devstack sudo[104248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6 1073741824
Sep 09 04:06:17 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:17 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.262s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:06:17 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Deleted volume successfully.
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3a5cc2c0-52d5-4961-91c6-e9722b2b7999 tempest-ProjectReaderTests-2086815997 None] Lock "cinder-edfdca34-902e-460b-9b45-99c7b4f59935-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:17 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6 1073741824" returned: 0 in 0.456s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:17 devstack sudo[104255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6
Sep 09 04:06:17 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Flow 'volume_create_manager' (d36b82bb-f6ab-46a7-85fc-e81e989d0d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326a2805-28b4-404f-a01d-1434de2d73bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326a2805-28b4-404f-a01d-1434de2d73bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-935062884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6427ad73-30ad-41d4-9678-6c314bfd76e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b88c5c3148425f8253bd8aca84e273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:18Z,use_quota=True,user_id='18e2ceec0e444e1e9745d69fd5ad82ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e4c67d-ad4d-42a9-8fe3-c7c70dd18061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e4c67d-ad4d-42a9-8fe3-c7c70dd18061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9a74fb-8bd2-47c2-af51-01e3dd39540b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9a74fb-8bd2-47c2-af51-01e3dd39540b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6427ad73-30ad-41d4-9678-6c314bfd76e1', 'volume_name': 'volume-6427ad73-30ad-41d4-9678-6c314bfd76e1', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0eb1c88-a8ca-45b7-bb40-583080b3b8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0eb1c88-a8ca-45b7-bb40-583080b3b8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9581045-1d37-42e0-8f49-546beeb8a97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:18 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Volume 6427ad73-30ad-41d4-9678-6c314bfd76e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6427ad73-30ad-41d4-9678-6c314bfd76e1', 'volume_size': 1}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:18 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6" returned: 0 in 0.285s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.078s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-935062884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6427ad73-30ad-41d4-9678-6c314bfd76e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b88c5c3148425f8253bd8aca84e273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:18Z,use_quota=True,user_id='18e2ceec0e444e1e9745d69fd5ad82ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Creating volume 6427ad73-30ad-41d4-9678-6c314bfd76e1 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:06:18 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6427ad73-30ad-41d4-9678-6c314bfd76e1 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:18 devstack sudo[104258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6427ad73-30ad-41d4-9678-6c314bfd76e1 1073741824
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027ee95b-e3d2-4804-b212-c93ef197d8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78fbe876-caa8-457d-a3e8-3392d66789c6', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:18 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bc3b35-e479-4beb-a1c5-badb35375826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:18 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Volume volume-78fbe876-caa8-457d-a3e8-3392d66789c6 (78fbe876-caa8-457d-a3e8-3392d66789c6): created successfully
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bc3b35-e479-4beb-a1c5-badb35375826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Flow 'volume_create_manager' (f83f6a5a-81ee-4d67-ae2e-08459e525480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:18 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c8936a9a-6bb6-421d-913d-fd0e31932807 tempest-VolumesSnapshotListTestJSON-1534203148 None] Created volume successfully.
Sep 09 04:06:18 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6427ad73-30ad-41d4-9678-6c314bfd76e1 1073741824" returned: 0 in 0.420s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6427ad73-30ad-41d4-9678-6c314bfd76e1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:18 devstack sudo[104263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6427ad73-30ad-41d4-9678-6c314bfd76e1
Sep 09 04:06:18 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:18 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6427ad73-30ad-41d4-9678-6c314bfd76e1" returned: 0 in 0.238s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9581045-1d37-42e0-8f49-546beeb8a97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6427ad73-30ad-41d4-9678-6c314bfd76e1', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09af360a-976e-4250-834f-2a5346716398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:18 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Volume volume-6427ad73-30ad-41d4-9678-6c314bfd76e1 (6427ad73-30ad-41d4-9678-6c314bfd76e1): created successfully
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09af360a-976e-4250-834f-2a5346716398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Flow 'volume_create_manager' (d36b82bb-f6ab-46a7-85fc-e81e989d0d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:18 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a767336b-66fa-4201-8033-ab37ba558dbc tempest-ProjectReaderTests-2086815997 None] Created volume successfully.
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Acquiring lock "cinder-6427ad73-30ad-41d4-9678-6c314bfd76e1-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Lock "cinder-6427ad73-30ad-41d4-9678-6c314bfd76e1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Acquiring lock "cinder-quobyte-6427ad73-30ad-41d4-9678-6c314bfd76e1" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Lock "cinder-quobyte-6427ad73-30ad-41d4-9678-6c314bfd76e1" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[083015b6-d7ce-4d9b-bfa7-2b20a71cdda7]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6427ad73-30ad-41d4-9678-6c314bfd76e1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:19 devstack sudo[104266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6427ad73-30ad-41d4-9678-6c314bfd76e1
Sep 09 04:06:19 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:19 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6427ad73-30ad-41d4-9678-6c314bfd76e1" returned: 0 in 0.420s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6427ad73-30ad-41d4-9678-6c314bfd76e1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:19 devstack sudo[104271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6427ad73-30ad-41d4-9678-6c314bfd76e1
Sep 09 04:06:19 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] Creating offline snapshot 4b083544-e0db-4081-ac22-56c2b29f91c1 of volume 78fbe876-caa8-457d-a3e8-3392d66789c6 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7e598f-9d4a-4b15-8f62-d93f09619b0f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:19 devstack sudo[104273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6
Sep 09 04:06:19 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:19 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6427ad73-30ad-41d4-9678-6c314bfd76e1" returned: 0 in 0.261s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Lock "cinder-quobyte-6427ad73-30ad-41d4-9678-6c314bfd76e1" released by "delete_volume" :: held 0.725s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Created reservations ['772ae943-9513-4e4c-8ba2-4e6ce99e1846', '4bc2f847-280e-44ee-ad42-5224ce7e7bcc', '150639fb-3986-40a4-94c5-30f33593703a', 'aa481bbf-4393-4016-b6e2-4ffd388608ba'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:20 devstack sudo[104279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:06:20 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:20 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6" returned: 0 in 0.383s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:20 devstack sudo[104281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 1G
Sep 09 04:06:20 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:20 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.265s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:20 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:06:20 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Deleted volume successfully.
Sep 09 04:06:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6579c60f-74b9-40a9-91de-00e79039ee3d tempest-ProjectReaderTests-2086815997 None] Lock "cinder-6427ad73-30ad-41d4-9678-6c314bfd76e1-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:20 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 1G" returned: 0 in 0.415s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fbe876-caa8-457d-a3e8-3392d66789c6 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:20 devstack sudo[104288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fbe876-caa8-457d-a3e8-3392d66789c6 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1
Sep 09 04:06:20 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:20 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fbe876-caa8-457d-a3e8-3392d66789c6 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1" returned: 0 in 0.316s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:20 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 is being set with open permissions: ugo+rw
Sep 09 04:06:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:20 devstack sudo[104294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1
Sep 09 04:06:20 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:21 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1" returned: 0 in 0.246s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:21 devstack sudo[104297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.info
Sep 09 04:06:21 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:21 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.info" returned: 0 in 0.274s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:21 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.info is being set with open permissions: ugo+rw
Sep 09 04:06:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:21 devstack sudo[104300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.info
Sep 09 04:06:21 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:21 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.info" returned: 0 in 0.250s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:21 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-5a67d282-aa2e-470c-84af-1d7260391af5 tempest-VolumesSnapshotListTestJSON-1534203148 None] Create snapshot completed successfully
Sep 09 04:06:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:22 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] Creating offline snapshot 1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 of volume 78fbe876-caa8-457d-a3e8-3392d66789c6 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:06:22 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7dfa0f-4b76-4a90-bd57-1fe26a2bee5f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:23 devstack sudo[104303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1
Sep 09 04:06:23 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:23 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1" returned: 0 in 0.349s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:23 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78fbe876-caa8-457d-a3e8-3392d66789c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:06:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:23 devstack sudo[104308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 1G
Sep 09 04:06:23 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:23 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 1G" returned: 0 in 0.398s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:23 devstack sudo[104313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0
Sep 09 04:06:23 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:23 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0" returned: 0 in 0.276s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:23 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 is being set with open permissions: ugo+rw
Sep 09 04:06:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:23 devstack sudo[104324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0
Sep 09 04:06:23 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:24 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0" returned: 0 in 0.243s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:24 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=185,cinder:INSERT=56,cinder:UPDATE=256,cinder:DELETE=22 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:06:24 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=176,cinder:INSERT=75,cinder:UPDATE=240,cinder:DELETE=19 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:06:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.356s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:24 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-66246bf0-0ceb-442a-976b-14c15d55d51e tempest-VolumesSnapshotListTestJSON-1534203148 None] Create snapshot completed successfully
Sep 09 04:06:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] Creating offline snapshot 2dc8df87-23af-44be-8120-f7f3767628f0 of volume 78fbe876-caa8-457d-a3e8-3392d66789c6 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:06:25 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e226c8c0-fe11-4e1e-87cf-d749e43ce6a8]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:25 devstack sudo[104327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0
Sep 09 04:06:25 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:25 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0" returned: 0 in 0.364s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78fbe876-caa8-457d-a3e8-3392d66789c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:06:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:25 devstack sudo[104333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0 1G
Sep 09 04:06:25 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:25 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0 1G" returned: 0 in 0.413s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:25 devstack sudo[104339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0
Sep 09 04:06:25 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:26 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0" returned: 0 in 0.273s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:26 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0 is being set with open permissions: ugo+rw
Sep 09 04:06:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:26 devstack sudo[104344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0
Sep 09 04:06:26 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:26 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0" returned: 0 in 0.234s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.379s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:26 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-74984eca-694d-42cc-8603-085543208a3c tempest-VolumesSnapshotListTestJSON-1534203148 None] Create snapshot completed successfully
Sep 09 04:06:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:06:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:27 devstack sudo[104347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:06:27 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:27 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.257s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:06:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:06:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 04:06:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "cinder-2dc8df87-23af-44be-8120-f7f3767628f0-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-2dc8df87-23af-44be-8120-f7f3767628f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "cinder-quobyte-78fbe876-caa8-457d-a3e8-3392d66789c6" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-78fbe876-caa8-457d-a3e8-3392d66789c6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "cinder-quobyte-2dc8df87-23af-44be-8120-f7f3767628f0" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-2dc8df87-23af-44be-8120-f7f3767628f0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Deleting offline snapshot 2dc8df87-23af-44be-8120-f7f3767628f0 of volume 78fbe876-caa8-457d-a3e8-3392d66789c6 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] snapshot_file for this snap is: volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d05094-dc4c-4807-b889-6de601103d34]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:28 devstack sudo[104350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0
Sep 09 04:06:28 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:28 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0" returned: 0 in 0.346s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78fbe876-caa8-457d-a3e8-3392d66789c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01fbf2d-87a0-4542-86d4-eae176ad6e82]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:28 devstack sudo[104355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0
Sep 09 04:06:28 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:29 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0" returned: 0 in 0.355s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78fbe876-caa8-457d-a3e8-3392d66789c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:06:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:29 devstack sudo[104360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0
Sep 09 04:06:29 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:29 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0" returned: 0 in 0.380s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:29 devstack sudo[104365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0
Sep 09 04:06:29 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:29 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.2dc8df87-23af-44be-8120-f7f3767628f0" returned: 0 in 0.234s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-2dc8df87-23af-44be-8120-f7f3767628f0" released by "_delete_snapshot" :: held 1.401s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-78fbe876-caa8-457d-a3e8-3392d66789c6" released by "delete_snapshot" :: held 1.421s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:29 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Created reservations ['348b448f-1765-4195-9964-857076b880b2', 'a3853fcd-6c14-4d41-8885-988bfccf89a2', 'fb0177c6-f4a9-4d51-9ef3-92763e4e83c2', 'ed1800be-5160-4046-b77a-d9740dd129b7'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:06:29 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Delete snapshot completed successfully.
Sep 09 04:06:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-32ffd072-385d-406f-bf61-73a538663ebc tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-2dc8df87-23af-44be-8120-f7f3767628f0-delete_snapshot" released by "delete_snapshot" :: held 1.542s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "cinder-1a290356-f0e2-4e83-a4c2-1f5ea20ccee0-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-1a290356-f0e2-4e83-a4c2-1f5ea20ccee0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "cinder-quobyte-78fbe876-caa8-457d-a3e8-3392d66789c6" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-78fbe876-caa8-457d-a3e8-3392d66789c6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "cinder-quobyte-1a290356-f0e2-4e83-a4c2-1f5ea20ccee0" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-1a290356-f0e2-4e83-a4c2-1f5ea20ccee0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Deleting offline snapshot 1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 of volume 78fbe876-caa8-457d-a3e8-3392d66789c6 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] snapshot_file for this snap is: volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[045e4f31-2ebb-407c-abd0-afaf635f1cd7]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:30 devstack sudo[104368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0
Sep 09 04:06:30 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:30 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0" returned: 0 in 0.356s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78fbe876-caa8-457d-a3e8-3392d66789c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd25f7e-4455-4d1e-8d73-cd8f77e03b55]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:30 devstack sudo[104373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1
Sep 09 04:06:30 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:31 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1" returned: 0 in 0.359s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78fbe876-caa8-457d-a3e8-3392d66789c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:06:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:31 devstack sudo[104378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0
Sep 09 04:06:31 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:31 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0" returned: 0 in 0.351s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:31 devstack sudo[104383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0
Sep 09 04:06:31 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:31 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.1a290356-f0e2-4e83-a4c2-1f5ea20ccee0" returned: 0 in 0.242s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-1a290356-f0e2-4e83-a4c2-1f5ea20ccee0" released by "_delete_snapshot" :: held 1.402s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-78fbe876-caa8-457d-a3e8-3392d66789c6" released by "delete_snapshot" :: held 1.423s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:31 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Created reservations ['6ed48175-0667-490b-9024-7e1c1b5d7a61', 'e0ba600b-57ff-46f4-8a37-07e93d6428e4', '6bccb047-4aab-4d24-818c-b466ebc70b2c', '97052258-0822-4ff6-9f0d-9212d5bd58d8'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:06:31 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Delete snapshot completed successfully.
Sep 09 04:06:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-26c53699-b197-44c9-a7a0-914f0f3b81e8 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-1a290356-f0e2-4e83-a4c2-1f5ea20ccee0-delete_snapshot" released by "delete_snapshot" :: held 1.550s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "cinder-4b083544-e0db-4081-ac22-56c2b29f91c1-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-4b083544-e0db-4081-ac22-56c2b29f91c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "cinder-quobyte-78fbe876-caa8-457d-a3e8-3392d66789c6" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-78fbe876-caa8-457d-a3e8-3392d66789c6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "cinder-quobyte-4b083544-e0db-4081-ac22-56c2b29f91c1" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-4b083544-e0db-4081-ac22-56c2b29f91c1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Deleting offline snapshot 4b083544-e0db-4081-ac22-56c2b29f91c1 of volume 78fbe876-caa8-457d-a3e8-3392d66789c6 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] snapshot_file for this snap is: volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0755b156-5c0a-4f48-ac46-ce2c85bdfbea]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:32 devstack sudo[104387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1
Sep 09 04:06:32 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:32 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1" returned: 0 in 0.336s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78fbe876-caa8-457d-a3e8-3392d66789c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[5178f10f-d244-4b0c-9a21-b29eac658594]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:33 devstack sudo[104392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6
Sep 09 04:06:33 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:33 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6" returned: 0 in 0.342s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:33 devstack sudo[104397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1
Sep 09 04:06:33 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:33 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1" returned: 0 in 0.326s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:33 devstack sudo[104403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1
Sep 09 04:06:33 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:33 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6.4b083544-e0db-4081-ac22-56c2b29f91c1" returned: 0 in 0.242s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-4b083544-e0db-4081-ac22-56c2b29f91c1" released by "_delete_snapshot" :: held 1.339s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-78fbe876-caa8-457d-a3e8-3392d66789c6" released by "delete_snapshot" :: held 1.361s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:33 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Created reservations ['a89ed8fc-229f-4c18-93b0-3051769d93ee', 'bf7da9a2-401c-4ef0-9b52-613319f61ed5', '2047dc6e-0c49-4356-b8f6-69037d770379', '29a3a3c2-1537-4ca2-83c1-9f71631d35c3'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:06:33 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Delete snapshot completed successfully.
Sep 09 04:06:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3b0200b9-c041-4f3b-9053-484eb1443c86 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-4b083544-e0db-4081-ac22-56c2b29f91c1-delete_snapshot" released by "delete_snapshot" :: held 1.481s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "cinder-78fbe876-caa8-457d-a3e8-3392d66789c6-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-78fbe876-caa8-457d-a3e8-3392d66789c6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "cinder-quobyte-78fbe876-caa8-457d-a3e8-3392d66789c6" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-78fbe876-caa8-457d-a3e8-3392d66789c6" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:34 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaee7d01-66e4-4b1b-872c-5fb2627cda47]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:34 devstack sudo[104406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6
Sep 09 04:06:34 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:35 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6" returned: 0 in 0.364s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:35 devstack sudo[104413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6
Sep 09 04:06:35 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:35 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-78fbe876-caa8-457d-a3e8-3392d66789c6" returned: 0 in 0.247s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-quobyte-78fbe876-caa8-457d-a3e8-3392d66789c6" released by "delete_volume" :: held 0.671s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Created reservations ['db9ebfa8-5057-4868-a5bb-7a91df0dc904', '31087e5b-09c3-4716-8f86-8e61bf741338', '4aed080b-61e1-4e2e-954c-755e5fdb6b23', '5c4c3f51-ff85-4715-8027-159290919b0e'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:35 devstack sudo[104417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:06:35 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:35 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.244s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:06:35 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Deleted volume successfully.
Sep 09 04:06:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0292d60d-74d0-4822-9c23-a886953f2f20 tempest-VolumesSnapshotListTestJSON-1534203148 None] Lock "cinder-78fbe876-caa8-457d-a3e8-3392d66789c6-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Flow 'volume_create_manager' (ed9d37c4-61a7-4f48-b6b5-32eaeea280b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23e5f73-c7cd-4683-a623-97c132e008ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23e5f73-c7cd-4683-a623-97c132e008ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-578621856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c805d9-7abb-4862-8c4e-3cd8417d5b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754b63434c8c4196b7a1dd6b34d12547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:40Z,use_quota=True,user_id='5ef99d66a8c7443fa71c7b1b3a5907ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1dc3075-5652-4b0b-be28-247284b6f348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1dc3075-5652-4b0b-be28-247284b6f348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc53b5ae-747f-4423-acdf-ace0be218d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc53b5ae-747f-4423-acdf-ace0be218d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c805d9-7abb-4862-8c4e-3cd8417d5b6e', 'volume_name': 'volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e', 'volume_size': 2}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91857dd-476d-451d-ba68-d7b17ccf825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91857dd-476d-451d-ba68-d7b17ccf825c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f44ca7-1107-4c99-a72d-b9b181442149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:39 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Volume 08c805d9-7abb-4862-8c4e-3cd8417d5b6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e', 'volume_size': 2}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-578621856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c805d9-7abb-4862-8c4e-3cd8417d5b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754b63434c8c4196b7a1dd6b34d12547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:06:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:06:40Z,use_quota=True,user_id='5ef99d66a8c7443fa71c7b1b3a5907ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Creating volume 08c805d9-7abb-4862-8c4e-3cd8417d5b6e {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:06:39 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:06:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e 2147483648 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:39 devstack sudo[104420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e 2147483648
Sep 09 04:06:39 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:40 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e 2147483648" returned: 0 in 0.441s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:40 devstack sudo[104425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e
Sep 09 04:06:40 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:40 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e" returned: 0 in 0.246s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f44ca7-1107-4c99-a72d-b9b181442149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e', 'volume_size': 2}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d78b120-23ef-4dcf-bcc5-73101f122ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:06:40 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Volume volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e (08c805d9-7abb-4862-8c4e-3cd8417d5b6e): created successfully
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d78b120-23ef-4dcf-bcc5-73101f122ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Flow 'volume_create_manager' (ed9d37c4-61a7-4f48-b6b5-32eaeea280b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:06:40 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-33378983-53cc-4871-9d7d-1385b3164687 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Created volume successfully.
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Creating offline snapshot f643c908-221c-423a-9256-5fce4d029631 of volume 08c805d9-7abb-4862-8c4e-3cd8417d5b6e {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe602f5d-d2ff-456a-86b5-03e5db72db03]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:40 devstack sudo[104428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e
Sep 09 04:06:40 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:41 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e" returned: 0 in 0.358s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631 2G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:41 devstack sudo[104433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631 2G
Sep 09 04:06:41 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:41 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631 2G" returned: 0 in 0.381s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:41 devstack sudo[104438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631
Sep 09 04:06:41 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:41 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631" returned: 0 in 0.289s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:41 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631 is being set with open permissions: ugo+rw
Sep 09 04:06:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:41 devstack sudo[104443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631
Sep 09 04:06:41 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:42 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631" returned: 0 in 0.245s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:42 devstack sudo[104446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.info
Sep 09 04:06:42 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:42 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.info" returned: 0 in 0.244s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:42 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.info is being set with open permissions: ugo+rw
Sep 09 04:06:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:42 devstack sudo[104449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.info
Sep 09 04:06:42 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:42 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.info" returned: 0 in 0.248s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:42 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8899c4b5-dab9-459f-b7f8-061e9aac4717 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Create snapshot completed successfully
Sep 09 04:06:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Acquiring lock "cinder-f643c908-221c-423a-9256-5fce4d029631-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "cinder-f643c908-221c-423a-9256-5fce4d029631-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Acquiring lock "cinder-quobyte-08c805d9-7abb-4862-8c4e-3cd8417d5b6e" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "cinder-quobyte-08c805d9-7abb-4862-8c4e-3cd8417d5b6e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Acquiring lock "cinder-quobyte-f643c908-221c-423a-9256-5fce4d029631" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "cinder-quobyte-f643c908-221c-423a-9256-5fce4d029631" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Deleting offline snapshot f643c908-221c-423a-9256-5fce4d029631 of volume 08c805d9-7abb-4862-8c4e-3cd8417d5b6e {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:06:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] snapshot_file for this snap is: volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:06:43 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27038e9-319d-4549-a733-73dbdf30419b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:43 devstack sudo[104452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631
Sep 09 04:06:43 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:43 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631" returned: 0 in 0.338s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:06:43 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8b6b7c-ed1a-4c36-bfdc-7f90bd22a1a4]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:43 devstack sudo[104457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e
Sep 09 04:06:43 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:43 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e" returned: 0 in 0.343s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:43 devstack sudo[104462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631
Sep 09 04:06:43 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:44 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631" returned: 0 in 0.334s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:44 devstack sudo[104467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631
Sep 09 04:06:44 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:44 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e.f643c908-221c-423a-9256-5fce4d029631" returned: 0 in 0.236s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "cinder-quobyte-f643c908-221c-423a-9256-5fce4d029631" released by "_delete_snapshot" :: held 1.346s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "cinder-quobyte-08c805d9-7abb-4862-8c4e-3cd8417d5b6e" released by "delete_snapshot" :: held 1.367s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:44 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Created reservations ['9320e5b9-b8fe-49b9-a60b-536e10fa9e87', 'ebe41636-5a2d-473f-8466-484be462f34d', '5865df81-c011-47c3-a7f9-d911c048ee0c', '2d1ae0a5-1689-4146-b403-10a3873f19ce'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:06:44 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Delete snapshot completed successfully.
Sep 09 04:06:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-422838e8-f3ee-475c-b059-c265095280eb tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "cinder-f643c908-221c-423a-9256-5fce4d029631-delete_snapshot" released by "delete_snapshot" :: held 1.490s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Acquiring lock "cinder-08c805d9-7abb-4862-8c4e-3cd8417d5b6e-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "cinder-08c805d9-7abb-4862-8c4e-3cd8417d5b6e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Acquiring lock "cinder-quobyte-08c805d9-7abb-4862-8c4e-3cd8417d5b6e" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "cinder-quobyte-08c805d9-7abb-4862-8c4e-3cd8417d5b6e" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[7304a2b1-fe0b-41a8-b405-57827c35a8e1]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:45 devstack sudo[104471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e
Sep 09 04:06:45 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:45 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e" returned: 0 in 0.342s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:45 devstack sudo[104476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e
Sep 09 04:06:45 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:45 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-08c805d9-7abb-4862-8c4e-3cd8417d5b6e" returned: 0 in 0.237s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "cinder-quobyte-08c805d9-7abb-4862-8c4e-3cd8417d5b6e" released by "delete_volume" :: held 0.636s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Created reservations ['fb42c689-536d-4ec5-a812-9bcd0a848d15', '792d81fa-6011-42a4-8ac2-a2219417ea17', 'd837337d-ff94-4848-8091-a95a16dc83fa', '0bf03de0-6871-4df0-8eab-b1d47ef8d6dd'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:06:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:06:46 devstack sudo[104479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:06:46 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:06:46 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root
Sep 09 04:06:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.239s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:06:46 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:06:46 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Deleted volume successfully.
Sep 09 04:06:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-93ba29ea-a4c1-4374-b6a4-98d988d61800 tempest-VolumesSnapshotNegativeTestJSON-80058664 None] Lock "cinder-08c805d9-7abb-4862-8c4e-3cd8417d5b6e-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:06:57 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=39,cinder:UPDATE=43,cinder:DELETE=4,cinder:INSERT=13 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:06:57 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=39,cinder:UPDATE=46,cinder:INSERT=13,cinder:DELETE=2 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Flow 'volume_create_manager' (2ef3b8e4-3a98-4bd9-ba6a-1913b2dfd209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886ce082-d708-40ed-b19b-76d4beebdce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886ce082-d708-40ed-b19b-76d4beebdce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-885939638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c71db2-92e7-46f1-a854-62f1de1ccb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db368c8f1a8544df849b6e1ce7a0b315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:07:10Z,use_quota=True,user_id='8aab47dc4e1345cc9d597c998b46331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2175cb33-d16a-4862-983d-ff0ed87e1ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2175cb33-d16a-4862-983d-ff0ed87e1ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5aca8e-b62e-40d1-bc66-3d6b1b6d9fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5aca8e-b62e-40d1-bc66-3d6b1b6d9fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c71db2-92e7-46f1-a854-62f1de1ccb04', 'volume_name': 'volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e8063c-8792-40fe-9262-12ba9fdd06dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e8063c-8792-40fe-9262-12ba9fdd06dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ddc175-deec-4db6-8fdb-9b7b3373ea6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:07:10 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Volume b9c71db2-92e7-46f1-a854-62f1de1ccb04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04', 'volume_size': 1}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-885939638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c71db2-92e7-46f1-a854-62f1de1ccb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db368c8f1a8544df849b6e1ce7a0b315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:07:10Z,use_quota=True,user_id='8aab47dc4e1345cc9d597c998b46331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Creating volume b9c71db2-92e7-46f1-a854-62f1de1ccb04 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:07:10 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:07:10 devstack sudo[104523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 1073741824
Sep 09 04:07:10 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:07:10 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 1073741824" returned: 0 in 0.449s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:07:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:07:10 devstack sudo[104529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04
Sep 09 04:07:10 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:07:11 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root
Sep 09 04:07:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04" returned: 0 in 0.271s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:07:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:07:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:07:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ddc175-deec-4db6-8fdb-9b7b3373ea6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:07:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f8d61c-493a-4e51-8476-a644d484a144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:07:11 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Volume volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 (b9c71db2-92e7-46f1-a854-62f1de1ccb04): created successfully
Sep 09 04:07:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f8d61c-493a-4e51-8476-a644d484a144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:07:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Flow 'volume_create_manager' (2ef3b8e4-3a98-4bd9-ba6a-1913b2dfd209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:07:11 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-aa2ba058-1265-4789-a28b-745e18fd271f tempest-TestStampPattern-1770903668 None] Created volume successfully.
Sep 09 04:07:21 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:07:21 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:07:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:07:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:07:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:07:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:07:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:07:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:07:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:07:27 devstack sudo[104628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:07:27 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:07:27 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root
Sep 09 04:07:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.241s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:07:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:07:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:07:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 04:07:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 04:07:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-05674f48-ef3e-43df-8337-a8e10c10745e req-ab64b6a8-1bdc-498f-88db-4ab54b4940e4 tempest-TestStampPattern-1770903668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:07:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-05674f48-ef3e-43df-8337-a8e10c10745e req-ab64b6a8-1bdc-498f-88db-4ab54b4940e4 tempest-TestStampPattern-1770903668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:07:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-05674f48-ef3e-43df-8337-a8e10c10745e req-ab64b6a8-1bdc-498f-88db-4ab54b4940e4 tempest-TestStampPattern-1770903668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:07:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-05674f48-ef3e-43df-8337-a8e10c10745e req-ab64b6a8-1bdc-498f-88db-4ab54b4940e4 tempest-TestStampPattern-1770903668 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd5a2d60-9fb2-4403-9f77-5a724121e93d', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 04:07:39 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-05674f48-ef3e-43df-8337-a8e10c10745e req-ab64b6a8-1bdc-498f-88db-4ab54b4940e4 tempest-TestStampPattern-1770903668 None] attachment_update completed successfully.
Sep 09 04:07:43 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-7dedbd11-410a-4f80-8269-2bcba3d0f053 req-8d6beb89-4102-458f-8379-a712aeda885f tempest-TestStampPattern-1770903668 None] Terminate volume connection completed successfully.
Sep 09 04:07:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-7dedbd11-410a-4f80-8269-2bcba3d0f053 req-8d6beb89-4102-458f-8379-a712aeda885f tempest-TestStampPattern-1770903668 None] Deleting attachment fd5a2d60-9fb2-4403-9f77-5a724121e93d. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 04:07:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:07:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:07:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] Creating offline snapshot ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf of volume b9c71db2-92e7-46f1-a854-62f1de1ccb04 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:07:44 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa764e2-cbef-42e6-8b5c-cd69c50311a9]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:07:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:07:44 devstack sudo[105096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04
Sep 09 04:07:44 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:07:44 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root
Sep 09 04:07:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04" returned: 0 in 0.344s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:07:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:07:44 devstack sudo[105101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf 1G
Sep 09 04:07:44 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:07:45 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root
Sep 09 04:07:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf 1G" returned: 0 in 0.360s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:07:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:07:45 devstack sudo[105107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf
Sep 09 04:07:45 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:07:45 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root
Sep 09 04:07:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf" returned: 0 in 0.271s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:07:45 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf is being set with open permissions: ugo+rw
Sep 09 04:07:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:07:45 devstack sudo[105113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf
Sep 09 04:07:45 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:07:45 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root
Sep 09 04:07:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf" returned: 0 in 0.239s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:07:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:07:45 devstack sudo[105116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.info
Sep 09 04:07:45 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:07:45 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root
Sep 09 04:07:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.info" returned: 0 in 0.241s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:07:45 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.info is being set with open permissions: ugo+rw
Sep 09 04:07:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:07:46 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.info
Sep 09 04:07:46 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:07:46 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Sep 09 04:07:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.info" returned: 0 in 0.227s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:07:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.758s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:07:46 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9c0a20c9-5825-4f4b-9c6b-d065c163b49a tempest-TestStampPattern-1770903668 None] Create snapshot completed successfully
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Flow 'volume_create_manager' (be157e9b-4cf9-4fb8-b3fc-97c596394a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e8053a-6e39-4f4a-95f8-d5294c046f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e8053a-6e39-4f4a-95f8-d5294c046f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1976399588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065a7da3-f670-4719-aec6-3e3b49d78d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db368c8f1a8544df849b6e1ce7a0b315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:07:53Z,use_quota=True,user_id='8aab47dc4e1345cc9d597c998b46331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddee8f63-11da-4622-8233-1e4acf339a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddee8f63-11da-4622-8233-1e4acf339a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b190ad05-3145-4b08-9ab3-a5c1b78a97a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b190ad05-3145-4b08-9ab3-a5c1b78a97a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '065a7da3-f670-4719-aec6-3e3b49d78d7b', 'volume_name': 'volume-065a7da3-f670-4719-aec6-3e3b49d78d7b', 'volume_size': 1, 'snapshot_id': 'ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153c5117-141e-47f2-9cbd-37d20a4e24c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153c5117-141e-47f2-9cbd-37d20a4e24c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017c5e11-1956-4736-ae55-b43f7d541319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:07:53 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Volume 065a7da3-f670-4719-aec6-3e3b49d78d7b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-065a7da3-f670-4719-aec6-3e3b49d78d7b', 'volume_size': 1, 'snapshot_id': 'ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf'}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Acquiring lock "cinder-quobyte-ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf-065a7da3-f670-4719-aec6-3e3b49d78d7b" by "_create_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Lock "cinder-quobyte-ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf-065a7da3-f670-4719-aec6-3e3b49d78d7b" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Creating volume 065a7da3-f670-4719-aec6-3e3b49d78d7b from snapshot ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf {{(pid=87558) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Acquiring lock "cinder-quobyte-065a7da3-f670-4719-aec6-3e3b49d78d7b" by "_copy_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Lock "cinder-quobyte-065a7da3-f670-4719-aec6-3e3b49d78d7b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] snapshot: ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf, volume: 065a7da3-f670-4719-aec6-3e3b49d78d7b,  {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[328f0d73-1bc9-436d-b20b-177d13f43aed]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:07:53 devstack sudo[105147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf
Sep 09 04:07:53 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:07:53 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf" returned: 0 in 0.367s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91eccd4-9379-494a-937c-a50b98c7112b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:07:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:07:53 devstack sudo[105153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04
Sep 09 04:07:53 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:07:54 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root
Sep 09 04:07:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04" returned: 0 in 0.403s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:07:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 04:07:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Creating direct copy from snapshot {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 04:07:54 devstack cinder-volume[87558]: DEBUG cinder.utils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Path /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b not found in is_blk_device check {{(pid=87558) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 04:07:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:07:54 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b
Sep 09 04:07:54 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:07:59 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Sep 09 04:07:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b" returned: 0 in 5.746s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:07:59 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 04:07:59 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Converted 1024.00 MB image at 178.17 MB/s
Sep 09 04:07:59 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b is being set with open permissions: ugo+rw
Sep 09 04:07:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:07:59 devstack sudo[105187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b
Sep 09 04:07:59 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:08:00 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root
Sep 09 04:08:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b" returned: 0 in 0.320s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:08:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Lock "cinder-quobyte-065a7da3-f670-4719-aec6-3e3b49d78d7b" released by "_copy_volume_from_snapshot" :: held 6.929s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:08:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Lock "cinder-quobyte-ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf-065a7da3-f670-4719-aec6-3e3b49d78d7b" released by "_create_volume_from_snapshot" :: held 7.003s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:08:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.025s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:08:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017c5e11-1956-4736-ae55-b43f7d541319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065a7da3-f670-4719-aec6-3e3b49d78d7b', 'volume_size': 1, 'snapshot_id': 'ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:08:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e0e78f-2608-4272-998c-31705639f477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:08:00 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Volume volume-065a7da3-f670-4719-aec6-3e3b49d78d7b (065a7da3-f670-4719-aec6-3e3b49d78d7b): created successfully
Sep 09 04:08:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e0e78f-2608-4272-998c-31705639f477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:08:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Flow 'volume_create_manager' (be157e9b-4cf9-4fb8-b3fc-97c596394a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:08:00 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a2dc3a56-cd4d-4862-8ed3-e35ca8dfa32e tempest-TestStampPattern-1770903668 None] Created volume successfully.
Sep 09 04:08:10 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:08:10 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=17,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:08:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:08:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:08:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:08:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:08:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:08:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:08:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:08:27 devstack sudo[105310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:08:27 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:08:27 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root
Sep 09 04:08:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.241s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:08:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:08:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:08:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 04:08:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 04:08:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-22c2ef94-14b6-42de-9c3f-49ef92fff672 req-4dca362e-a1a0-45f0-9b06-4c55cca7c65a tempest-TestStampPattern-1770903668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:08:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-22c2ef94-14b6-42de-9c3f-49ef92fff672 req-4dca362e-a1a0-45f0-9b06-4c55cca7c65a tempest-TestStampPattern-1770903668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:08:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [req-22c2ef94-14b6-42de-9c3f-49ef92fff672 req-4dca362e-a1a0-45f0-9b06-4c55cca7c65a tempest-TestStampPattern-1770903668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:08:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-22c2ef94-14b6-42de-9c3f-49ef92fff672 req-4dca362e-a1a0-45f0-9b06-4c55cca7c65a tempest-TestStampPattern-1770903668 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc', 'name': 'volume-065a7da3-f670-4719-aec6-3e3b49d78d7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '903c2dae-3e00-4382-b2dc-713c2ebfa727', 'enforce_multipath': True} {{(pid=87558) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 04:08:42 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-22c2ef94-14b6-42de-9c3f-49ef92fff672 req-4dca362e-a1a0-45f0-9b06-4c55cca7c65a tempest-TestStampPattern-1770903668 None] attachment_update completed successfully.
Sep 09 04:08:44 devstack cinder-volume[87558]: INFO cinder.volume.manager [req-cb706198-7b2c-4516-9c7a-bf51914db9c3 req-d7494adf-2d6b-4d87-90c0-120768922e75 tempest-TestStampPattern-1770903668 None] Terminate volume connection completed successfully.
Sep 09 04:08:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [req-cb706198-7b2c-4516-9c7a-bf51914db9c3 req-d7494adf-2d6b-4d87-90c0-120768922e75 tempest-TestStampPattern-1770903668 None] Deleting attachment 903c2dae-3e00-4382-b2dc-713c2ebfa727. {{(pid=87558) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Acquiring lock "cinder-065a7da3-f670-4719-aec6-3e3b49d78d7b-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Lock "cinder-065a7da3-f670-4719-aec6-3e3b49d78d7b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Acquiring lock "cinder-quobyte-065a7da3-f670-4719-aec6-3e3b49d78d7b" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Lock "cinder-quobyte-065a7da3-f670-4719-aec6-3e3b49d78d7b" acquired by "delete_volume" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[564f3038-1bf3-4d2b-b96c-e446a2e109b9]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:08:49 devstack sudo[105786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b
Sep 09 04:08:49 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:08:49 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b" returned: 0 in 0.352s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:08:49 devstack sudo[105791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b
Sep 09 04:08:49 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:08:49 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-065a7da3-f670-4719-aec6-3e3b49d78d7b" returned: 0 in 0.234s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Lock "cinder-quobyte-065a7da3-f670-4719-aec6-3e3b49d78d7b" released by "delete_volume" :: held 0.623s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Created reservations ['4c551bed-14b2-4ffd-b9e2-c501dc289ad8', 'a7489864-21ec-445f-a42e-0b9223b8a75f', '757864f4-d276-4865-8493-07c4e2aa46b4', '2be1b70b-6977-49b5-bcd3-3f7f2559cfcb'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:08:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:08:49 devstack sudo[105794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:08:49 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:08:50 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.253s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:08:50 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Deleted volume successfully.
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fedf6b4e-252a-459d-8dfd-501d866874aa tempest-TestStampPattern-1770903668 None] Lock "cinder-065a7da3-f670-4719-aec6-3e3b49d78d7b-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Acquiring lock "cinder-ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Lock "cinder-ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Acquiring lock "cinder-quobyte-b9c71db2-92e7-46f1-a854-62f1de1ccb04" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Lock "cinder-quobyte-b9c71db2-92e7-46f1-a854-62f1de1ccb04" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Acquiring lock "cinder-quobyte-ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Lock "cinder-quobyte-ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Deleting offline snapshot ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf of volume b9c71db2-92e7-46f1-a854-62f1de1ccb04 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] snapshot_file for this snap is: volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fdac21-a15e-41da-8e5a-33aecee2a4b0]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:08:50 devstack sudo[105797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf
Sep 09 04:08:50 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:08:50 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf" returned: 0 in 0.378s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c260392c-1699-4d85-bb99-416c65f2b4c3]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:08:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:08:51 devstack sudo[105802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04
Sep 09 04:08:51 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:08:51 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root
Sep 09 04:08:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04" returned: 0 in 0.493s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:08:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:08:51 devstack sudo[105807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf
Sep 09 04:08:51 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:08:51 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root
Sep 09 04:08:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf" returned: 0 in 0.312s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:08:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:08:51 devstack sudo[105813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf
Sep 09 04:08:51 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:08:51 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root
Sep 09 04:08:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04.ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf" returned: 0 in 0.259s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:08:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Lock "cinder-quobyte-ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf" released by "_delete_snapshot" :: held 1.534s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:08:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Lock "cinder-quobyte-b9c71db2-92e7-46f1-a854-62f1de1ccb04" released by "delete_snapshot" :: held 1.554s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:08:52 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Created reservations ['b71e45f3-66ec-43b3-9e96-8cee79608bc3', 'bbdb4496-565b-4792-bb92-10b2f25a096a', 'ab02e3da-bd22-490f-9038-a32857d98f5d', '6dce14d7-4429-4896-8825-ca8eb7ccab26'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:08:52 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Delete snapshot completed successfully.
Sep 09 04:08:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-525f1e01-d1ac-49d9-b9b9-0054afa21af2 tempest-TestStampPattern-1770903668 None] Lock "cinder-ef1fa8f1-e05b-4e70-9b26-6ecd10e598bf-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:08:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Acquiring lock "cinder-b9c71db2-92e7-46f1-a854-62f1de1ccb04-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:08:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Lock "cinder-b9c71db2-92e7-46f1-a854-62f1de1ccb04-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:08:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Acquiring lock "cinder-quobyte-b9c71db2-92e7-46f1-a854-62f1de1ccb04" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Lock "cinder-quobyte-b9c71db2-92e7-46f1-a854-62f1de1ccb04" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06bb537-38f9-4bc8-bf77-6a4e940478e3]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:08:56 devstack sudo[105846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04
Sep 09 04:08:56 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:08:56 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04" returned: 0 in 0.364s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:08:56 devstack sudo[105852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04
Sep 09 04:08:56 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:08:56 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b9c71db2-92e7-46f1-a854-62f1de1ccb04" returned: 0 in 0.253s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Lock "cinder-quobyte-b9c71db2-92e7-46f1-a854-62f1de1ccb04" released by "delete_volume" :: held 0.671s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Created reservations ['e60ba986-06da-4e23-88d6-e054639638a1', '87d15300-99b1-4317-9afe-f37952d6495b', '5e5c727c-8cb3-4cb8-a779-68ad405181e8', '628aa023-5221-4de3-a6d5-27205dca3023'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:08:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:08:56 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:08:56 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:08:57 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Sep 09 04:08:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.247s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:08:57 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:08:57 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Deleted volume successfully.
Sep 09 04:08:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4c873bdf-413b-4a30-afd4-08b0ee3055b2 tempest-TestStampPattern-1770903668 None] Lock "cinder-b9c71db2-92e7-46f1-a854-62f1de1ccb04-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:06 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=19,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:09:07 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=28,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Flow 'volume_create_manager' (5e6d92e9-ef3e-459e-b5ca-00773fc4e823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a510af-d5b1-4059-b6ec-4aacb3541744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a510af-d5b1-4059-b6ec-4aacb3541744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1171950292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce70b53a-df66-4bf2-bf24-3a81e2088564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bccdfcc908c4f43a8948261145832f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:25Z,use_quota=True,user_id='e342304b8188494a947fde6c47e56e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ad725d-ccd7-4c59-9c00-26f5405091a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ad725d-ccd7-4c59-9c00-26f5405091a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64173320-7d5a-4c08-98ee-960df50a7909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64173320-7d5a-4c08-98ee-960df50a7909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce70b53a-df66-4bf2-bf24-3a81e2088564', 'volume_name': 'volume-ce70b53a-df66-4bf2-bf24-3a81e2088564', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148f8f50-8247-403b-8a68-06b881a3a762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148f8f50-8247-403b-8a68-06b881a3a762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bcb64f2-18b9-4044-be54-9058dbd1d594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Volume ce70b53a-df66-4bf2-bf24-3a81e2088564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce70b53a-df66-4bf2-bf24-3a81e2088564', 'volume_size': 1}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1171950292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce70b53a-df66-4bf2-bf24-3a81e2088564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bccdfcc908c4f43a8948261145832f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:25Z,use_quota=True,user_id='e342304b8188494a947fde6c47e56e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Creating volume ce70b53a-df66-4bf2-bf24-3a81e2088564 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:25 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ce70b53a-df66-4bf2-bf24-3a81e2088564 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:25 devstack sudo[105950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ce70b53a-df66-4bf2-bf24-3a81e2088564 1073741824
Sep 09 04:09:25 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Flow 'volume_create_manager' (5b764f07-38b4-4f7d-9dd5-05ddbb6e018a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d45841b-eedb-4a8c-b585-4b2ef4b9c51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d45841b-eedb-4a8c-b585-4b2ef4b9c51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-492982995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a192a0f2-ab1c-4cdc-b594-9442b60c2799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436aa57f43604c5fab1455fa5071c5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:25Z,use_quota=True,user_id='fb59e441104e49e1addc458ff10d72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75463a51-2cda-49aa-a25a-095c4310524c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75463a51-2cda-49aa-a25a-095c4310524c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82804d46-56e6-4587-975a-1139ecf25c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82804d46-56e6-4587-975a-1139ecf25c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a192a0f2-ab1c-4cdc-b594-9442b60c2799', 'volume_name': 'volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770bc197-e8d9-48cd-82cc-97555d28f893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770bc197-e8d9-48cd-82cc-97555d28f893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b4393d-023a-494d-83b0-3328b1a0b2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume a192a0f2-ab1c-4cdc-b594-9442b60c2799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799', 'volume_size': 1}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Flow 'volume_create_manager' (b2f7c52f-e1b6-4683-9545-f84183a586c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d5b4e8-4372-4cf0-af6f-6e8dfe6bdc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d5b4e8-4372-4cf0-af6f-6e8dfe6bdc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2048239321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2fae85-579f-4b30-9309-fd180ece4e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bccdfcc908c4f43a8948261145832f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:26Z,use_quota=True,user_id='e342304b8188494a947fde6c47e56e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275db06d-acf7-436c-affa-1ed325868614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275db06d-acf7-436c-affa-1ed325868614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89329bb-a12e-419f-8f09-350a8e54f7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89329bb-a12e-419f-8f09-350a8e54f7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c2fae85-579f-4b30-9309-fd180ece4e57', 'volume_name': 'volume-5c2fae85-579f-4b30-9309-fd180ece4e57', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be61a27a-41af-43b3-b062-2681d49685e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be61a27a-41af-43b3-b062-2681d49685e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10549c4-4c0f-4333-90dd-8ae72b416347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Volume 5c2fae85-579f-4b30-9309-fd180ece4e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c2fae85-579f-4b30-9309-fd180ece4e57', 'volume_size': 1}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:25 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Flow 'volume_create_manager' (3616d5b1-f2cd-4140-8a88-7af93411e705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185db70e-9714-40a7-ac9e-151da28a81fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ce70b53a-df66-4bf2-bf24-3a81e2088564 1073741824" returned: 0 in 0.654s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185db70e-9714-40a7-ac9e-151da28a81fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1021176900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5012fe54-5852-4684-9264-37f5f3713d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb114133a62044a890cf391d19947ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:26Z,use_quota=True,user_id='314fb6cd276340668641c7e82f4c9f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e1404d-31b0-4641-9d2e-6b747ddc7ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e1404d-31b0-4641-9d2e-6b747ddc7ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20eb051b-39d4-49e9-ab2d-6af8ae0a9d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20eb051b-39d4-49e9-ab2d-6af8ae0a9d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5012fe54-5852-4684-9264-37f5f3713d0d', 'volume_name': 'volume-5012fe54-5852-4684-9264-37f5f3713d0d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e01dacf-cb80-4cc0-9404-06d6cb1cbee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e01dacf-cb80-4cc0-9404-06d6cb1cbee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc332cb-bdca-45c2-a92d-a02f32b99b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume 5012fe54-5852-4684-9264-37f5f3713d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5012fe54-5852-4684-9264-37f5f3713d0d', 'volume_size': 1}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ce70b53a-df66-4bf2-bf24-3a81e2088564 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:26 devstack sudo[105956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ce70b53a-df66-4bf2-bf24-3a81e2088564
Sep 09 04:09:26 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Flow 'volume_create_manager' (cadf95cd-17c5-4767-921c-aca4ffba60f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7dc7f1-b7d1-4d68-988b-2d7662c73a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7dc7f1-b7d1-4d68-988b-2d7662c73a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1091246803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e0ee54-af65-41f5-a0b7-db8aed2fce70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bccdfcc908c4f43a8948261145832f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:26Z,use_quota=True,user_id='e342304b8188494a947fde6c47e56e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2706de-6967-49a9-96e4-befeb0d2eb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2706de-6967-49a9-96e4-befeb0d2eb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5718228-8414-4843-a716-92a58ca40a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5718228-8414-4843-a716-92a58ca40a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e0ee54-af65-41f5-a0b7-db8aed2fce70', 'volume_name': 'volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2d7d1f-07b3-45eb-8bf1-3400516672bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2d7d1f-07b3-45eb-8bf1-3400516672bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3610f2b-f726-479d-a117-b519af5218a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Volume f9e0ee54-af65-41f5-a0b7-db8aed2fce70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70', 'volume_size': 1}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:26 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ce70b53a-df66-4bf2-bf24-3a81e2088564" returned: 0 in 0.336s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.970s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-492982995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a192a0f2-ab1c-4cdc-b594-9442b60c2799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436aa57f43604c5fab1455fa5071c5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:25Z,use_quota=True,user_id='fb59e441104e49e1addc458ff10d72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Creating volume a192a0f2-ab1c-4cdc-b594-9442b60c2799 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:26 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:26 devstack sudo[105959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799 1073741824
Sep 09 04:09:26 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bcb64f2-18b9-4044-be54-9058dbd1d594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce70b53a-df66-4bf2-bf24-3a81e2088564', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c34a22-0a81-4cd5-b303-9caa87db2d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Flow 'volume_create_manager' (1711d4cd-610e-4fdc-9f51-2776008bc72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11bd4b2-6093-4b6d-9823-d7ba00388e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Volume volume-ce70b53a-df66-4bf2-bf24-3a81e2088564 (ce70b53a-df66-4bf2-bf24-3a81e2088564): created successfully
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c34a22-0a81-4cd5-b303-9caa87db2d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Flow 'volume_create_manager' (5e6d92e9-ef3e-459e-b5ca-00773fc4e823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11bd4b2-6093-4b6d-9823-d7ba00388e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1998967222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e949b149-f702-47f4-8d8c-98e08ed5d1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bccdfcc908c4f43a8948261145832f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:26Z,use_quota=True,user_id='e342304b8188494a947fde6c47e56e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc269ce-15d7-4a41-8ccc-6e359de45436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc269ce-15d7-4a41-8ccc-6e359de45436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03984a7a-49a0-4daa-b525-fb902e0a77d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03984a7a-49a0-4daa-b525-fb902e0a77d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e949b149-f702-47f4-8d8c-98e08ed5d1a5', 'volume_name': 'volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dec878a-37f9-4169-bce9-19991936ff00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dec878a-37f9-4169-bce9-19991936ff00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3629c49c-b030-4ddb-89d6-ae7fb59ca56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Volume e949b149-f702-47f4-8d8c-98e08ed5d1a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5', 'volume_size': 1}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:26 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7bfba40e-2968-4ef3-a9c0-88eb7ac6b1c8 tempest-CreateVolumesFromImageTest-1957623572 None] Created volume successfully.
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Flow 'volume_create_manager' (1ab7c61d-fd51-44fa-ba85-8fba2e7f8259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e31dd1-ab35-4970-b4c9-f1a456a50909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e31dd1-ab35-4970-b4c9-f1a456a50909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-267900822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d43e4e1-4d35-4172-874e-522ebb22664e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bccdfcc908c4f43a8948261145832f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:27Z,use_quota=True,user_id='e342304b8188494a947fde6c47e56e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171cc1f9-68e2-4062-b93f-48c7fc1063a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171cc1f9-68e2-4062-b93f-48c7fc1063a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a099dc9-b337-4dd0-8d0c-341fe0237111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a099dc9-b337-4dd0-8d0c-341fe0237111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d43e4e1-4d35-4172-874e-522ebb22664e', 'volume_name': 'volume-7d43e4e1-4d35-4172-874e-522ebb22664e', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6797ba39-f44c-4b90-9f97-a22c6dd2c4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6797ba39-f44c-4b90-9f97-a22c6dd2c4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520955cb-8bf3-4785-9a9f-18722dfe2682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:26 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Volume 7d43e4e1-4d35-4172-874e-522ebb22664e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d43e4e1-4d35-4172-874e-522ebb22664e', 'volume_size': 1}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:27 devstack sudo[105965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:27 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:27 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799 1073741824" returned: 0 in 0.596s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:27 devstack sudo[105967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799
Sep 09 04:09:27 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:27 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.271s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 04:09:27 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799" returned: 0 in 0.262s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.535s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2048239321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2fae85-579f-4b30-9309-fd180ece4e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bccdfcc908c4f43a8948261145832f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:26Z,use_quota=True,user_id='e342304b8188494a947fde6c47e56e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Creating volume 5c2fae85-579f-4b30-9309-fd180ece4e57 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:27 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5c2fae85-579f-4b30-9309-fd180ece4e57 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b4393d-023a-494d-83b0-3328b1a0b2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:27 devstack sudo[105971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5c2fae85-579f-4b30-9309-fd180ece4e57 1073741824
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9bcb5e-f596-486f-9319-fd118c3b4322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:27 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:27 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799 (a192a0f2-ab1c-4cdc-b594-9442b60c2799): created successfully
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9bcb5e-f596-486f-9319-fd118c3b4322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Flow 'volume_create_manager' (5b764f07-38b4-4f7d-9dd5-05ddbb6e018a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:27 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-52e7561a-1829-457a-a7e6-3de0a5245ecd tempest-CreateVolumesFromSnapshotTest-1025528933 None] Created volume successfully.
Sep 09 04:09:27 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5c2fae85-579f-4b30-9309-fd180ece4e57 1073741824" returned: 0 in 0.458s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5c2fae85-579f-4b30-9309-fd180ece4e57 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:27 devstack sudo[105977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5c2fae85-579f-4b30-9309-fd180ece4e57
Sep 09 04:09:27 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:28 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5c2fae85-579f-4b30-9309-fd180ece4e57" returned: 0 in 0.248s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.042s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1021176900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5012fe54-5852-4684-9264-37f5f3713d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb114133a62044a890cf391d19947ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:26Z,use_quota=True,user_id='314fb6cd276340668641c7e82f4c9f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Creating volume 5012fe54-5852-4684-9264-37f5f3713d0d {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:28 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5012fe54-5852-4684-9264-37f5f3713d0d 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10549c4-4c0f-4333-90dd-8ae72b416347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2fae85-579f-4b30-9309-fd180ece4e57', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:28 devstack sudo[105980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5012fe54-5852-4684-9264-37f5f3713d0d 1073741824
Sep 09 04:09:28 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e0c815-83d7-44a1-b583-eeb526cd593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:28 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Volume volume-5c2fae85-579f-4b30-9309-fd180ece4e57 (5c2fae85-579f-4b30-9309-fd180ece4e57): created successfully
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e0c815-83d7-44a1-b583-eeb526cd593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Flow 'volume_create_manager' (b2f7c52f-e1b6-4683-9545-f84183a586c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:28 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f5443784-7ad3-40ed-a7f0-cb2807aecbe0 tempest-CreateVolumesFromImageTest-1957623572 None] Created volume successfully.
Sep 09 04:09:28 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5012fe54-5852-4684-9264-37f5f3713d0d 1073741824" returned: 0 in 0.514s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5012fe54-5852-4684-9264-37f5f3713d0d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:28 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5012fe54-5852-4684-9264-37f5f3713d0d
Sep 09 04:09:28 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:28 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5012fe54-5852-4684-9264-37f5f3713d0d" returned: 0 in 0.278s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.574s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1091246803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e0ee54-af65-41f5-a0b7-db8aed2fce70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bccdfcc908c4f43a8948261145832f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:26Z,use_quota=True,user_id='e342304b8188494a947fde6c47e56e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Creating volume f9e0ee54-af65-41f5-a0b7-db8aed2fce70 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:28 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc332cb-bdca-45c2-a92d-a02f32b99b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5012fe54-5852-4684-9264-37f5f3713d0d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455637bd-d12c-4af6-b2f2-a7ed3e2c938e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:29 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70 1073741824
Sep 09 04:09:29 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:29 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume volume-5012fe54-5852-4684-9264-37f5f3713d0d (5012fe54-5852-4684-9264-37f5f3713d0d): created successfully
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455637bd-d12c-4af6-b2f2-a7ed3e2c938e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Flow 'volume_create_manager' (3616d5b1-f2cd-4140-8a88-7af93411e705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:29 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0dedf92d-3b3a-4356-a395-a3077f0d7e3f tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Created volume successfully.
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Flow 'volume_create_manager' (2316ace7-8c30-45a3-a899-005ef665d9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49992266-b431-4b4c-bd3c-e09cd6ee8e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49992266-b431-4b4c-bd3c-e09cd6ee8e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59656e4-c1e8-470e-bf48-ce9931bc989d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c8f8936d99468da4c11cb8a34087e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:29Z,use_quota=True,user_id='9f190ecb8d514212a66b778b743effb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ec9fa11-e1c6-4551-add8-eda9310cfa43),volume_type_id=8ec9fa11-e1c6-4551-add8-eda9310cfa43)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b153c1-b40a-46fa-b605-9e6c2c1c6387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b153c1-b40a-46fa-b605-9e6c2c1c6387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec59b9a-32aa-49be-9584-e01eed974c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.image.glance [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Creating Keystone auth plugin from conf {{(pid=87558) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 04:09:29 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70 1073741824" returned: 0 in 0.472s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec59b9a-32aa-49be-9584-e01eed974c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c59656e4-c1e8-470e-bf48-ce9931bc989d', 'volume_name': 'volume-c59656e4-c1e8-470e-bf48-ce9931bc989d', 'volume_size': 1, 'image_id': '727e47d6-0f6c-48c1-bd4d-10f33e695e85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/727e47d6-0f6c-48c1-bd4d-10f33e695e85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '11decd7f617557a47a63f4147a448074', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6c8f8936d99468da4c11cb8a34087e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c6a1c24cb7019a4316fc58f7ccd75e22dee47f835d877d31e02eee6bc13ed3e4d351a426a7e3060ad7efaf59d8459ab4bd961076d7200517b4450828e6f3a970', 'id': '727e47d6-0f6c-48c1-bd4d-10f33e695e85', 'created_at': datetime.datetime(2026, 9, 9, 2, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 2, 9, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/727e47d6-0f6c-48c1-bd4d-10f33e695e85/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01b5730>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c77f70-4528-4b2a-add8-7fbef2605075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c77f70-4528-4b2a-add8-7fbef2605075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0b911f-24d9-4c46-8818-f8abe9729ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:29 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Volume c59656e4-c1e8-470e-bf48-ce9931bc989d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c59656e4-c1e8-470e-bf48-ce9931bc989d', 'volume_size': 1, 'image_id': '727e47d6-0f6c-48c1-bd4d-10f33e695e85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/727e47d6-0f6c-48c1-bd4d-10f33e695e85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '11decd7f617557a47a63f4147a448074', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6c8f8936d99468da4c11cb8a34087e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c6a1c24cb7019a4316fc58f7ccd75e22dee47f835d877d31e02eee6bc13ed3e4d351a426a7e3060ad7efaf59d8459ab4bd961076d7200517b4450828e6f3a970', 'id': '727e47d6-0f6c-48c1-bd4d-10f33e695e85', 'created_at': datetime.datetime(2026, 9, 9, 2, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 2, 9, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/727e47d6-0f6c-48c1-bd4d-10f33e695e85/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01b5730>}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Trying to clone c59656e4-c1e8-470e-bf48-ce9931bc989d from image 727e47d6-0f6c-48c1-bd4d-10f33e695e85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/727e47d6-0f6c-48c1-bd4d-10f33e695e85', 'metadata': {}}]). {{(pid=87558) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:29 devstack sudo[105995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70
Sep 09 04:09:29 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 04:09:29 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Image download 0.00 MB at 0.00 MB/s
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa324273-a383-4745-83a3-26b757693226]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:29 devstack sudo[105997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD
Sep 09 04:09:29 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:29 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70" returned: 0 in 0.263s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.025s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1998967222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e949b149-f702-47f4-8d8c-98e08ed5d1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bccdfcc908c4f43a8948261145832f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:26Z,use_quota=True,user_id='e342304b8188494a947fde6c47e56e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Creating volume e949b149-f702-47f4-8d8c-98e08ed5d1a5 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:29 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3610f2b-f726-479d-a117-b519af5218a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:29 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5 1073741824
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe8cbb8-ae9a-4487-b51e-8b0c78d9b250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:29 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:29 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Volume volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70 (f9e0ee54-af65-41f5-a0b7-db8aed2fce70): created successfully
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe8cbb8-ae9a-4487-b51e-8b0c78d9b250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Flow 'volume_create_manager' (cadf95cd-17c5-4767-921c-aca4ffba60f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:29 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0711a0ab-7e5b-4a08-bcce-4f12cb28ad3b tempest-CreateVolumesFromImageTest-1957623572 None] Created volume successfully.
Sep 09 04:09:29 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:30 devstack sudo[106004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD
Sep 09 04:09:30 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:30 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5 1073741824" returned: 0 in 0.542s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:30 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD" returned: 1 in 0.396s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Temporary image 727e47d6-0f6c-48c1-bd4d-10f33e695e85 is fetched for user 9f190ecb8d514212a66b778b743effb3. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:30 devstack sudo[106013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5
Sep 09 04:09:30 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Flow 'volume_create_manager' (ba9a53a4-e10f-4772-857c-9899bafff269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a527bbe-b32b-411a-a0d2-14ff68158a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a527bbe-b32b-411a-a0d2-14ff68158a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-570851621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e728153-84c1-4669-996d-d1ac37dfafb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb114133a62044a890cf391d19947ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:30Z,use_quota=True,user_id='314fb6cd276340668641c7e82f4c9f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab79908-69d3-44b9-80ca-3a40f975a501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab79908-69d3-44b9-80ca-3a40f975a501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e799b0-8884-4f45-bf98-53f8e5cf3e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e799b0-8884-4f45-bf98-53f8e5cf3e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e728153-84c1-4669-996d-d1ac37dfafb0', 'volume_name': 'volume-7e728153-84c1-4669-996d-d1ac37dfafb0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a8afa7-3d87-4351-8a7f-6a4148ffc73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a8afa7-3d87-4351-8a7f-6a4148ffc73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7e22f5-cab4-4417-adcf-1f36cbb1e210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:30 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume 7e728153-84c1-4669-996d-d1ac37dfafb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e728153-84c1-4669-996d-d1ac37dfafb0', 'volume_size': 1}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbc369d-7cec-4b2f-a1f3-8ae0049d5e9e]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:30 devstack sudo[106015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD
Sep 09 04:09:30 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:30 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5" returned: 0 in 0.328s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.754s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-267900822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d43e4e1-4d35-4172-874e-522ebb22664e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bccdfcc908c4f43a8948261145832f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:27Z,use_quota=True,user_id='e342304b8188494a947fde6c47e56e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Creating volume 7d43e4e1-4d35-4172-874e-522ebb22664e {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:30 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7d43e4e1-4d35-4172-874e-522ebb22664e 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3629c49c-b030-4ddb-89d6-ae7fb59ca56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8e92a0-c700-479a-942b-5185b5b98e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:30 devstack sudo[106018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7d43e4e1-4d35-4172-874e-522ebb22664e 1073741824
Sep 09 04:09:30 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:30 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Volume volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5 (e949b149-f702-47f4-8d8c-98e08ed5d1a5): created successfully
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8e92a0-c700-479a-942b-5185b5b98e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Flow 'volume_create_manager' (1711d4cd-610e-4fdc-9f51-2776008bc72a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2be73e9e-45f0-45cd-a849-af6d15a5549b tempest-CreateVolumesFromImageTest-1957623572 None] Created volume successfully.
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Flow 'volume_create_manager' (5ff409ad-c9f8-4f34-846e-3c7244474af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f01192-0511-42f7-960d-140c6d9fa5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f01192-0511-42f7-960d-140c6d9fa5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1172182665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4e6c8b-b716-4f92-b93c-4480c0486301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb114133a62044a890cf391d19947ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:31Z,use_quota=True,user_id='314fb6cd276340668641c7e82f4c9f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5231c1a4-ea8a-4dab-a3f1-fe058f9a536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5231c1a4-ea8a-4dab-a3f1-fe058f9a536a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65eb04c0-b4fa-4162-bf7f-f207e2511d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65eb04c0-b4fa-4162-bf7f-f207e2511d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4e6c8b-b716-4f92-b93c-4480c0486301', 'volume_name': 'volume-fd4e6c8b-b716-4f92-b93c-4480c0486301', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14648c12-b63f-4b0d-a319-e470a79f98d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14648c12-b63f-4b0d-a319-e470a79f98d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f217865-5396-45a5-9556-067c00c5d29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume fd4e6c8b-b716-4f92-b93c-4480c0486301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4e6c8b-b716-4f92-b93c-4480c0486301', 'volume_size': 1}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:31 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD" returned: 0 in 0.489s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:31 devstack sudo[106024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD
Sep 09 04:09:31 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Flow 'volume_create_manager' (60438ba1-9481-458c-b0ae-07d5716b0334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22c3e96-574b-445b-b851-316b00867a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22c3e96-574b-445b-b851-316b00867a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205325054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd9007d-ef9d-432c-b23d-583fcb3773b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb114133a62044a890cf391d19947ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:31Z,use_quota=True,user_id='314fb6cd276340668641c7e82f4c9f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6914cd20-8243-438e-a94c-19c56b38c9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6914cd20-8243-438e-a94c-19c56b38c9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f98286e-4e8e-455a-b127-5b08a1f8be1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f98286e-4e8e-455a-b127-5b08a1f8be1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd9007d-ef9d-432c-b23d-583fcb3773b9', 'volume_name': 'volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc50c8b7-0d72-41c6-856b-ebee0ee8238e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc50c8b7-0d72-41c6-856b-ebee0ee8238e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf8dc79-a23b-4c99-b4ac-c552ba907788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume bbd9007d-ef9d-432c-b23d-583fcb3773b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9', 'volume_size': 1}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7d43e4e1-4d35-4172-874e-522ebb22664e 1073741824" returned: 0 in 0.663s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7d43e4e1-4d35-4172-874e-522ebb22664e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:31 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD" returned: 1 in 0.408s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:31 devstack sudo[106031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7d43e4e1-4d35-4172-874e-522ebb22664e
Sep 09 04:09:31 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:31 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7d43e4e1-4d35-4172-874e-522ebb22664e" returned: 0 in 0.266s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.027s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520955cb-8bf3-4785-9a9f-18722dfe2682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d43e4e1-4d35-4172-874e-522ebb22664e', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a04bee7-050f-42e9-a710-9c01ad728418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Creating offline snapshot 23aebbba-a631-4bdc-b79f-0826a0297ee7 of volume a192a0f2-ab1c-4cdc-b594-9442b60c2799 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:09:31 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Volume volume-7d43e4e1-4d35-4172-874e-522ebb22664e (7d43e4e1-4d35-4172-874e-522ebb22664e): created successfully
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a04bee7-050f-42e9-a710-9c01ad728418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Flow 'volume_create_manager' (1ab7c61d-fd51-44fa-ba85-8fba2e7f8259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cefa887-926e-40e2-96b1-0b28e651af53]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Flow 'volume_create_manager' (65a4cbbe-94a8-4dbb-ae6e-ae7eecf17bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675de016-58b4-47a5-b8d3-6137b4c265fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675de016-58b4-47a5-b8d3-6137b4c265fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-694532430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0ccf74-2909-4f80-8b14-4298faa51317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb114133a62044a890cf391d19947ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:32Z,use_quota=True,user_id='314fb6cd276340668641c7e82f4c9f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2d70d0-ebfe-4ff3-8615-370c0b1c7b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2d70d0-ebfe-4ff3-8615-370c0b1c7b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f2ae4a-ef48-4244-9c8e-ff956ccf866e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f2ae4a-ef48-4244-9c8e-ff956ccf866e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca0ccf74-2909-4f80-8b14-4298faa51317', 'volume_name': 'volume-ca0ccf74-2909-4f80-8b14-4298faa51317', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd1dd66-c088-4303-b279-6faf4b0ea662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd1dd66-c088-4303-b279-6faf4b0ea662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a840e5e8-5e3d-405b-8928-20d342cc7a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:31 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume ca0ccf74-2909-4f80-8b14-4298faa51317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca0ccf74-2909-4f80-8b14-4298faa51317', 'volume_size': 1}
Sep 09 04:09:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:31 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b3b2e2b4-be89-4b19-a93f-2158182070a5 tempest-CreateVolumesFromImageTest-1957623572 None] Created volume successfully.
Sep 09 04:09:31 devstack sudo[106034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799
Sep 09 04:09:31 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Flow 'volume_create_manager' (a8df30f1-3350-47b7-bbd4-1e35842971f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cfa984-cb75-43af-9ada-81b8f4df5c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cfa984-cb75-43af-9ada-81b8f4df5c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1799479127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4f1966-3739-4de8-858a-7bdbc376870e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb114133a62044a890cf391d19947ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:32Z,use_quota=True,user_id='314fb6cd276340668641c7e82f4c9f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326bf33e-1cb7-4928-8f47-5ab73aa1a200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326bf33e-1cb7-4928-8f47-5ab73aa1a200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:32 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8120c51e-a85b-4fa4-af46-82ca66e79a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8120c51e-a85b-4fa4-af46-82ca66e79a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4f1966-3739-4de8-858a-7bdbc376870e', 'volume_name': 'volume-de4f1966-3739-4de8-858a-7bdbc376870e', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ccae32-5c2b-4e9a-b086-09e65c5f2e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ccae32-5c2b-4e9a-b086-09e65c5f2e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1b7b48-6db2-4de8-ba17-200c13ecd1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:32 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume de4f1966-3739-4de8-858a-7bdbc376870e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4f1966-3739-4de8-858a-7bdbc376870e', 'volume_size': 1}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799" returned: 0 in 0.415s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:32 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7 1G
Sep 09 04:09:32 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "cinder-7d43e4e1-4d35-4172-874e-522ebb22664e-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-7d43e4e1-4d35-4172-874e-522ebb22664e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "cinder-quobyte-7d43e4e1-4d35-4172-874e-522ebb22664e" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-quobyte-7d43e4e1-4d35-4172-874e-522ebb22664e" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fd394c-1cd3-4b13-ae69-e6f22d60e2ed]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7d43e4e1-4d35-4172-874e-522ebb22664e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:32 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7 1G" returned: 0 in 0.444s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:32 devstack sudo[106047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7
Sep 09 04:09:32 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:32 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7d43e4e1-4d35-4172-874e-522ebb22664e
Sep 09 04:09:32 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:32 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7" returned: 0 in 0.297s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:32 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7 is being set with open permissions: ugo+rw
Sep 09 04:09:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:32 devstack sudo[106055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7
Sep 09 04:09:32 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:33 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7d43e4e1-4d35-4172-874e-522ebb22664e" returned: 0 in 0.379s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7d43e4e1-4d35-4172-874e-522ebb22664e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:33 devstack sudo[106058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7d43e4e1-4d35-4172-874e-522ebb22664e
Sep 09 04:09:33 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:33 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7" returned: 0 in 0.251s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:33 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7d43e4e1-4d35-4172-874e-522ebb22664e" returned: 0 in 0.246s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:33 devstack sudo[106062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.info
Sep 09 04:09:33 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-quobyte-7d43e4e1-4d35-4172-874e-522ebb22664e" released by "delete_volume" :: held 0.667s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Created reservations ['81fff4fb-b113-4992-aa09-db64082b0b1b', '943b621f-1e14-40b8-a8ac-b2699f0b7dfe', '82a2db14-bbac-485a-9774-71da6092d88b', '9fdea8c8-9688-4c27-b893-7135f4ab0bc2'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:33 devstack sudo[106064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:33 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:33 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.info" returned: 0 in 0.270s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:33 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.info is being set with open permissions: ugo+rw
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:33 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.info
Sep 09 04:09:33 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:33 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.256s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:33 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Deleted volume successfully.
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ab39a882-acd5-45dd-9a42-5b91cc583399 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-7d43e4e1-4d35-4172-874e-522ebb22664e-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "cinder-e949b149-f702-47f4-8d8c-98e08ed5d1a5-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-e949b149-f702-47f4-8d8c-98e08ed5d1a5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:33 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "cinder-quobyte-e949b149-f702-47f4-8d8c-98e08ed5d1a5" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.info" returned: 0 in 0.271s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.077s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.239s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-570851621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e728153-84c1-4669-996d-d1ac37dfafb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb114133a62044a890cf391d19947ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:30Z,use_quota=True,user_id='314fb6cd276340668641c7e82f4c9f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Creating volume 7e728153-84c1-4669-996d-d1ac37dfafb0 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:33 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7e728153-84c1-4669-996d-d1ac37dfafb0 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-quobyte-e949b149-f702-47f4-8d8c-98e08ed5d1a5" acquired by "delete_volume" :: waited 0.061s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:33 devstack sudo[106071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7e728153-84c1-4669-996d-d1ac37dfafb0 1073741824
Sep 09 04:09:33 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b2972c-9a95-4175-b20e-924c2ef9d028]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:33 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3089102e-dea1-4e75-bf7f-29ccc7808644 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Create snapshot completed successfully
Sep 09 04:09:33 devstack sudo[106073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5
Sep 09 04:09:33 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:34 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5" returned: 0 in 0.375s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:34 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5
Sep 09 04:09:34 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:34 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7e728153-84c1-4669-996d-d1ac37dfafb0 1073741824" returned: 0 in 0.471s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7e728153-84c1-4669-996d-d1ac37dfafb0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:34 devstack sudo[106085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7e728153-84c1-4669-996d-d1ac37dfafb0
Sep 09 04:09:34 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:34 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e949b149-f702-47f4-8d8c-98e08ed5d1a5" returned: 0 in 0.267s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-quobyte-e949b149-f702-47f4-8d8c-98e08ed5d1a5" released by "delete_volume" :: held 0.700s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:34 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7e728153-84c1-4669-996d-d1ac37dfafb0" returned: 0 in 0.272s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.550s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1172182665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4e6c8b-b716-4f92-b93c-4480c0486301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb114133a62044a890cf391d19947ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:31Z,use_quota=True,user_id='314fb6cd276340668641c7e82f4c9f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Creating volume fd4e6c8b-b716-4f92-b93c-4480c0486301 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:34 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4e6c8b-b716-4f92-b93c-4480c0486301 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Created reservations ['55345eb1-5fb4-402f-a5ae-e4b6d71fef7c', '8de0664f-9772-48b4-90b0-e27430728f5a', '5c5e722c-e7e0-45fd-b963-c7055965774d', '1c6c079c-47a6-4730-b091-c279978b2e3f'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7e22f5-cab4-4417-adcf-1f36cbb1e210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e728153-84c1-4669-996d-d1ac37dfafb0', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:34 devstack sudo[106089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4e6c8b-b716-4f92-b93c-4480c0486301 1073741824
Sep 09 04:09:34 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a519e2-a57e-4d24-8e92-b1bf3047aeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:34 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume volume-7e728153-84c1-4669-996d-d1ac37dfafb0 (7e728153-84c1-4669-996d-d1ac37dfafb0): created successfully
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a519e2-a57e-4d24-8e92-b1bf3047aeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Flow 'volume_create_manager' (ba9a53a4-e10f-4772-857c-9899bafff269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:34 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a3b8f070-ec1b-4871-aba8-40fc2d4e7136 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Created volume successfully.
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:34 devstack sudo[106091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:34 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "cinder-f9e0ee54-af65-41f5-a0b7-db8aed2fce70-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-f9e0ee54-af65-41f5-a0b7-db8aed2fce70-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "cinder-quobyte-f9e0ee54-af65-41f5-a0b7-db8aed2fce70" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:35 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.299s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:35 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Deleted volume successfully.
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-quobyte-f9e0ee54-af65-41f5-a0b7-db8aed2fce70" acquired by "delete_volume" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-de75960b-4baa-4049-b2a6-b23254465eb6 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-e949b149-f702-47f4-8d8c-98e08ed5d1a5-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b668057f-ebfd-4e9b-96a1-0d8cb6ef3958]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:35 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4e6c8b-b716-4f92-b93c-4480c0486301 1073741824" returned: 0 in 0.530s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4e6c8b-b716-4f92-b93c-4480c0486301 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:35 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70
Sep 09 04:09:35 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:35 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4e6c8b-b716-4f92-b93c-4480c0486301
Sep 09 04:09:35 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:35 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4e6c8b-b716-4f92-b93c-4480c0486301" returned: 0 in 0.331s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.118s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205325054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd9007d-ef9d-432c-b23d-583fcb3773b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb114133a62044a890cf391d19947ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:31Z,use_quota=True,user_id='314fb6cd276340668641c7e82f4c9f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Creating volume bbd9007d-ef9d-432c-b23d-583fcb3773b9 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:35 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:35 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70" returned: 0 in 0.512s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:35 devstack sudo[106109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9 1073741824
Sep 09 04:09:35 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f217865-5396-45a5-9556-067c00c5d29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4e6c8b-b716-4f92-b93c-4480c0486301', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7181868-6cdd-4e27-96f1-84d33610ef0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:35 devstack sudo[106111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70
Sep 09 04:09:35 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:35 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume volume-fd4e6c8b-b716-4f92-b93c-4480c0486301 (fd4e6c8b-b716-4f92-b93c-4480c0486301): created successfully
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7181868-6cdd-4e27-96f1-84d33610ef0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Flow 'volume_create_manager' (5ff409ad-c9f8-4f34-846e-3c7244474af1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Flow 'volume_create_manager' (2e40c8a6-72bd-4c9a-80de-15ec94016664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d73dc9-d5c2-4a43-83b9-29be37cc06da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d73dc9-d5c2-4a43-83b9-29be37cc06da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-221505108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6660b622-a4ca-46d9-b5ab-306d52c3da79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436aa57f43604c5fab1455fa5071c5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:36Z,use_quota=True,user_id='fb59e441104e49e1addc458ff10d72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16b7836-a78c-4f5c-8051-e09b17828520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16b7836-a78c-4f5c-8051-e09b17828520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01bb465-0a90-4bcb-9a31-de91f9b1e1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01bb465-0a90-4bcb-9a31-de91f9b1e1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6660b622-a4ca-46d9-b5ab-306d52c3da79', 'volume_name': 'volume-6660b622-a4ca-46d9-b5ab-306d52c3da79', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3174caf-0d9b-4a1c-bd68-3baaf6ea5354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3174caf-0d9b-4a1c-bd68-3baaf6ea5354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d029b453-303e-4549-a919-e18c304031e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:35 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume 6660b622-a4ca-46d9-b5ab-306d52c3da79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6660b622-a4ca-46d9-b5ab-306d52c3da79', 'volume_size': 1}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:35 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9b410971-97b3-4a3d-880a-3103f57b6a67 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Created volume successfully.
Sep 09 04:09:35 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f9e0ee54-af65-41f5-a0b7-db8aed2fce70" returned: 0 in 0.342s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-quobyte-f9e0ee54-af65-41f5-a0b7-db8aed2fce70" released by "delete_volume" :: held 0.903s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Created reservations ['97bcf379-06af-410a-b7d4-a26f112fe31d', 'bea35198-ecdd-4a7e-92f4-44f26e3a0dfe', '5ab92afc-3be4-4e97-a7bb-c7a5618f8019', 'bb5107fc-ea88-450c-a312-cc42e367381e'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Flow 'volume_create_manager' (6e4d18a7-0031-41be-a984-f45a99d72271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b72383-124c-4820-b353-20b0c70ddd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b72383-124c-4820-b353-20b0c70ddd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040370808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c074244-2784-4abf-9eb5-9c402d9b2554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436aa57f43604c5fab1455fa5071c5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:36Z,use_quota=True,user_id='fb59e441104e49e1addc458ff10d72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:36 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a1ab8c-f001-44d7-a0b0-b6fe0ad7cc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a1ab8c-f001-44d7-a0b0-b6fe0ad7cc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8300fd84-fe64-47c1-8754-aaf75cf20b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8300fd84-fe64-47c1-8754-aaf75cf20b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c074244-2784-4abf-9eb5-9c402d9b2554', 'volume_name': 'volume-1c074244-2784-4abf-9eb5-9c402d9b2554', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6228c8d-8f53-4e26-bffc-5596a0a378eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6228c8d-8f53-4e26-bffc-5596a0a378eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a912c2-a91f-466d-b60e-7e1d277fa716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:36 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume 1c074244-2784-4abf-9eb5-9c402d9b2554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c074244-2784-4abf-9eb5-9c402d9b2554', 'volume_size': 1}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9 1073741824" returned: 0 in 0.675s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:36 devstack sudo[106118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:36 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:36 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9
Sep 09 04:09:36 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:36 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Flow 'volume_create_manager' (a485b8b7-bacd-4ad0-bf55-f85920792464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358daeb2-1c7e-4fa8-8084-848423fb03dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.381s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358daeb2-1c7e-4fa8-8084-848423fb03dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1501533176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819b6cc9-cf24-4dd7-8601-8482d36ac14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436aa57f43604c5fab1455fa5071c5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:37Z,use_quota=True,user_id='fb59e441104e49e1addc458ff10d72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5143281-262f-4559-bba2-0101de4396a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5143281-262f-4559-bba2-0101de4396a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb69207f-91b9-437a-81e2-2dcf09e8bd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb69207f-91b9-437a-81e2-2dcf09e8bd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '819b6cc9-cf24-4dd7-8601-8482d36ac14d', 'volume_name': 'volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e20e09f-d934-45be-baff-11d634de415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:36 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e20e09f-d934-45be-baff-11d634de415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfa7e69-f86c-4521-bf23-1567f930f9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:36 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume 819b6cc9-cf24-4dd7-8601-8482d36ac14d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d', 'volume_size': 1}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:36 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Deleted volume successfully.
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9" returned: 0 in 0.415s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.233s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59656e4-c1e8-470e-bf48-ce9931bc989d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c8f8936d99468da4c11cb8a34087e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:29Z,use_quota=True,user_id='9f190ecb8d514212a66b778b743effb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ec9fa11-e1c6-4551-add8-eda9310cfa43),volume_type_id=8ec9fa11-e1c6-4551-add8-eda9310cfa43)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Creating volume c59656e4-c1e8-470e-bf48-ce9931bc989d {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:36 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:36 devstack sudo[106124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d 1073741824
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf8dc79-a23b-4c99-b4ac-c552ba907788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:36 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79eafd8-ea5f-429c-8864-d7e8b579be87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-337c195b-00dc-4cc9-93f1-15511fa29661 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-f9e0ee54-af65-41f5-a0b7-db8aed2fce70-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:36 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9 (bbd9007d-ef9d-432c-b23d-583fcb3773b9): created successfully
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79eafd8-ea5f-429c-8864-d7e8b579be87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:36 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Flow 'volume_create_manager' (60438ba1-9481-458c-b0ae-07d5716b0334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:36 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-5d075b76-d464-47be-903c-90348a7299cc tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Created volume successfully.
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Flow 'volume_create_manager' (e4148418-95af-46c9-9dfb-04f6b3879fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a72a143-d3a0-45d1-88a3-aedd293b7fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a72a143-d3a0-45d1-88a3-aedd293b7fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-900939246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197245f8-e094-4c7d-b1c7-ea5f079a65f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436aa57f43604c5fab1455fa5071c5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:37Z,use_quota=True,user_id='fb59e441104e49e1addc458ff10d72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2373aa-c4dd-4e02-ac2e-559227ba1f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2373aa-c4dd-4e02-ac2e-559227ba1f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f321b4-13c2-442b-8b31-0d0f93688de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f321b4-13c2-442b-8b31-0d0f93688de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197245f8-e094-4c7d-b1c7-ea5f079a65f7', 'volume_name': 'volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bb2a03-620a-4d39-bf26-78957d3be538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bb2a03-620a-4d39-bf26-78957d3be538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2033d17a-cc75-4cc5-bb53-587a3f42c3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:37 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume 197245f8-e094-4c7d-b1c7-ea5f079a65f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7', 'volume_size': 1}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "cinder-5c2fae85-579f-4b30-9309-fd180ece4e57-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-5c2fae85-579f-4b30-9309-fd180ece4e57-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:37 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d 1073741824" returned: 0 in 0.544s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "cinder-quobyte-5c2fae85-579f-4b30-9309-fd180ece4e57" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-quobyte-5c2fae85-579f-4b30-9309-fd180ece4e57" acquired by "delete_volume" :: waited 0.031s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:37 devstack sudo[106130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d
Sep 09 04:09:37 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9298951-9866-43db-a3b1-c0aefe5ae163]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5c2fae85-579f-4b30-9309-fd180ece4e57 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Flow 'volume_create_manager' (0e184bbf-3faa-4fcb-a180-377ed39a41ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90841d44-7d3a-4c03-a010-85a58549c22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90841d44-7d3a-4c03-a010-85a58549c22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-427685061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928985e1-d0b6-413e-ad77-0054aa8cbdc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436aa57f43604c5fab1455fa5071c5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:37Z,use_quota=True,user_id='fb59e441104e49e1addc458ff10d72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7117a9a5-66ee-42fb-a7c1-88b858e56885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7117a9a5-66ee-42fb-a7c1-88b858e56885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92531bda-0165-4a88-a38b-2d30f09548a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92531bda-0165-4a88-a38b-2d30f09548a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928985e1-d0b6-413e-ad77-0054aa8cbdc5', 'volume_name': 'volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:37 devstack sudo[106132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5c2fae85-579f-4b30-9309-fd180ece4e57
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fced78-db11-4d35-93a4-b6ec3e414002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:37 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fced78-db11-4d35-93a4-b6ec3e414002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20839b35-512f-425a-a535-cbb5ee6453f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:37 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume 928985e1-d0b6-413e-ad77-0054aa8cbdc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5', 'volume_size': 1}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:37 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d" returned: 0 in 0.265s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.683s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-694532430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0ccf74-2909-4f80-8b14-4298faa51317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb114133a62044a890cf391d19947ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:32Z,use_quota=True,user_id='314fb6cd276340668641c7e82f4c9f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Creating volume ca0ccf74-2909-4f80-8b14-4298faa51317 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:37 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ca0ccf74-2909-4f80-8b14-4298faa51317 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:37 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ca0ccf74-2909-4f80-8b14-4298faa51317 1073741824
Sep 09 04:09:37 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Attempting download of 727e47d6-0f6c-48c1-bd4d-10f33e695e85 ((None, [{'url': 'file:///opt/stack/data/glance/images/727e47d6-0f6c-48c1-bd4d-10f33e695e85', 'metadata': {}}])) to volume c59656e4-c1e8-470e-bf48-ce9931bc989d. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[80930e81-1ee2-4181-b42d-31766424665a]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_727e47d6-0f6c-48c1-bd4d-10f33e695e85_p0syngk8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:37 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5c2fae85-579f-4b30-9309-fd180ece4e57" returned: 0 in 0.441s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5c2fae85-579f-4b30-9309-fd180ece4e57 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:37 devstack sudo[106141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5c2fae85-579f-4b30-9309-fd180ece4e57
Sep 09 04:09:37 devstack sudo[106137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_727e47d6-0f6c-48c1-bd4d-10f33e695e85_p0syngk8
Sep 09 04:09:37 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:37 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:38 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ca0ccf74-2909-4f80-8b14-4298faa51317 1073741824" returned: 0 in 0.428s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ca0ccf74-2909-4f80-8b14-4298faa51317 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:38 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5c2fae85-579f-4b30-9309-fd180ece4e57" returned: 0 in 0.270s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:38 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-quobyte-5c2fae85-579f-4b30-9309-fd180ece4e57" released by "delete_volume" :: held 0.769s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:38 devstack sudo[106150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ca0ccf74-2909-4f80-8b14-4298faa51317
Sep 09 04:09:38 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_727e47d6-0f6c-48c1-bd4d-10f33e695e85_p0syngk8" returned: 0 in 0.390s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_727e47d6-0f6c-48c1-bd4d-10f33e695e85_p0syngk8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Created reservations ['ce241faa-74cb-4e8b-807c-af59591f01b3', '75806351-3c81-457a-87a4-7d4fd38899d5', 'b4bb6079-552c-4b29-bcfe-a69addaa0af2', '8635da3d-a2ca-4382-8e55-4b3710b50e82'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:38 devstack sudo[106152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_727e47d6-0f6c-48c1-bd4d-10f33e695e85_p0syngk8
Sep 09 04:09:38 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:38 devstack sudo[106154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:38 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:38 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ca0ccf74-2909-4f80-8b14-4298faa51317" returned: 0 in 0.279s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.148s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1799479127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4f1966-3739-4de8-858a-7bdbc376870e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb114133a62044a890cf391d19947ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:32Z,use_quota=True,user_id='314fb6cd276340668641c7e82f4c9f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Creating volume de4f1966-3739-4de8-858a-7bdbc376870e {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:38 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4f1966-3739-4de8-858a-7bdbc376870e 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a840e5e8-5e3d-405b-8928-20d342cc7a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca0ccf74-2909-4f80-8b14-4298faa51317', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fb60c7-47f5-4ec5-af1e-aa8378d0afa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:38 devstack sudo[106157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4f1966-3739-4de8-858a-7bdbc376870e 1073741824
Sep 09 04:09:38 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "cinder-ce70b53a-df66-4bf2-bf24-3a81e2088564-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:38 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_727e47d6-0f6c-48c1-bd4d-10f33e695e85_p0syngk8" returned: 1 in 0.380s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_727e47d6-0f6c-48c1-bd4d-10f33e695e85_p0syngk8' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-ce70b53a-df66-4bf2-bf24-3a81e2088564-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26836f7-2e49-4ad7-b090-d5a563fbcb47]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:38 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume volume-ca0ccf74-2909-4f80-8b14-4298faa51317 (ca0ccf74-2909-4f80-8b14-4298faa51317): created successfully
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fb60c7-47f5-4ec5-af1e-aa8378d0afa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Flow 'volume_create_manager' (65a4cbbe-94a8-4dbb-ae6e-ae7eecf17bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:38 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ba7abfd0-ceb0-40c7-bee2-4c937e42ccf3 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Created volume successfully.
Sep 09 04:09:38 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "cinder-quobyte-ce70b53a-df66-4bf2-bf24-3a81e2088564" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.339s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:38 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Deleted volume successfully.
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-quobyte-ce70b53a-df66-4bf2-bf24-3a81e2088564" acquired by "delete_volume" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bf75b12c-28be-4430-88b6-68729852edfe tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-5c2fae85-579f-4b30-9309-fd180ece4e57-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d406b798-d2ce-45f0-a0d9-4ef2fef88c9a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ce70b53a-df66-4bf2-bf24-3a81e2088564 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:38 devstack sudo[106162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD
Sep 09 04:09:38 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:38 devstack sudo[106163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ce70b53a-df66-4bf2-bf24-3a81e2088564
Sep 09 04:09:38 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:38 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:38 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4f1966-3739-4de8-858a-7bdbc376870e 1073741824" returned: 0 in 0.562s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4f1966-3739-4de8-858a-7bdbc376870e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:39 devstack sudo[106173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4f1966-3739-4de8-858a-7bdbc376870e
Sep 09 04:09:39 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:39 devstack sudo[106172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD
Sep 09 04:09:39 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:39 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ce70b53a-df66-4bf2-bf24-3a81e2088564" returned: 0 in 0.448s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ce70b53a-df66-4bf2-bf24-3a81e2088564 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:39 devstack sudo[106180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ce70b53a-df66-4bf2-bf24-3a81e2088564
Sep 09 04:09:39 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:39 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4f1966-3739-4de8-858a-7bdbc376870e" returned: 0 in 0.270s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.515s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-221505108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6660b622-a4ca-46d9-b5ab-306d52c3da79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436aa57f43604c5fab1455fa5071c5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:36Z,use_quota=True,user_id='fb59e441104e49e1addc458ff10d72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Creating volume 6660b622-a4ca-46d9-b5ab-306d52c3da79 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:39 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6660b622-a4ca-46d9-b5ab-306d52c3da79 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:39 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1b7b48-6db2-4de8-ba17-200c13ecd1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4f1966-3739-4de8-858a-7bdbc376870e', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:39 devstack sudo[106186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6660b622-a4ca-46d9-b5ab-306d52c3da79 1073741824
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0623426-4451-46bd-a29c-84f8cad1deb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:39 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD" returned: 1 in 0.386s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] 727e47d6-0f6c-48c1-bd4d-10f33e695e85 was raw, converting to qcow2 {{(pid=87558) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:39 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Volume volume-de4f1966-3739-4de8-858a-7bdbc376870e (de4f1966-3739-4de8-858a-7bdbc376870e): created successfully
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0623426-4451-46bd-a29c-84f8cad1deb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:39 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:39 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d
Sep 09 04:09:39 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Flow 'volume_create_manager' (a8df30f1-3350-47b7-bbd4-1e35842971f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ce70b53a-df66-4bf2-bf24-3a81e2088564" returned: 0 in 0.276s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:39 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c3b03114-51f7-4172-93bf-7b55dcb0e9b4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Created volume successfully.
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-quobyte-ce70b53a-df66-4bf2-bf24-3a81e2088564" released by "delete_volume" :: held 0.783s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Created reservations ['c4e5f818-5fa0-4932-bc03-26ac623ad83d', '3443041f-67f2-4e62-a3fa-75d22ebe1f53', 'e32de896-e045-4af4-9ae0-108070fd984b', '3c6609a4-071a-4ef1-9a62-47b4b6e76948'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:39 devstack sudo[106191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:39 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:39 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.307s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:39 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:39 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Deleted volume successfully.
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6660b622-a4ca-46d9-b5ab-306d52c3da79 1073741824" returned: 0 in 0.581s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7d2e1476-918e-4d70-ad49-c0c8636d8cb9 tempest-CreateVolumesFromImageTest-1957623572 None] Lock "cinder-ce70b53a-df66-4bf2-bf24-3a81e2088564-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6660b622-a4ca-46d9-b5ab-306d52c3da79 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:39 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d" returned: 0 in 0.620s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_727e47d6-0f6c-48c1-bd4d-10f33e695e85_xap0nwu3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 04:09:39 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Converted 0.00 MB image at 0.00 MB/s
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:39 devstack sudo[106202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6660b622-a4ca-46d9-b5ab-306d52c3da79
Sep 09 04:09:39 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "cinder-de4f1966-3739-4de8-858a-7bdbc376870e-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:39 devstack sudo[106203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d 1G
Sep 09 04:09:39 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-de4f1966-3739-4de8-858a-7bdbc376870e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "cinder-quobyte-de4f1966-3739-4de8-858a-7bdbc376870e" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-quobyte-de4f1966-3739-4de8-858a-7bdbc376870e" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc1a37b-83e7-4686-a0fd-4478c3c503d7]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4f1966-3739-4de8-858a-7bdbc376870e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:40 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4f1966-3739-4de8-858a-7bdbc376870e
Sep 09 04:09:40 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:40 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6660b622-a4ca-46d9-b5ab-306d52c3da79" returned: 0 in 0.348s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.055s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040370808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c074244-2784-4abf-9eb5-9c402d9b2554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436aa57f43604c5fab1455fa5071c5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:36Z,use_quota=True,user_id='fb59e441104e49e1addc458ff10d72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Creating volume 1c074244-2784-4abf-9eb5-9c402d9b2554 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:40 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1c074244-2784-4abf-9eb5-9c402d9b2554 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d029b453-303e-4549-a919-e18c304031e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6660b622-a4ca-46d9-b5ab-306d52c3da79', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:40 devstack sudo[106213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1c074244-2784-4abf-9eb5-9c402d9b2554 1073741824
Sep 09 04:09:40 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3740eb8-e316-44a6-976f-387e52eef2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:40 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume volume-6660b622-a4ca-46d9-b5ab-306d52c3da79 (6660b622-a4ca-46d9-b5ab-306d52c3da79): created successfully
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3740eb8-e316-44a6-976f-387e52eef2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Flow 'volume_create_manager' (2e40c8a6-72bd-4c9a-80de-15ec94016664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:40 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-56135ab4-31f7-4970-8525-d22451356a97 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Created volume successfully.
Sep 09 04:09:40 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d 1G" returned: 0 in 0.483s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Downloaded image 727e47d6-0f6c-48c1-bd4d-10f33e695e85 ((None, [{'url': 'file:///opt/stack/data/glance/images/727e47d6-0f6c-48c1-bd4d-10f33e695e85', 'metadata': {}}])) to volume c59656e4-c1e8-470e-bf48-ce9931bc989d successfully. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Temporary image 727e47d6-0f6c-48c1-bd4d-10f33e695e85 for user 9f190ecb8d514212a66b778b743effb3 is deleted. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Marking volume c59656e4-c1e8-470e-bf48-ce9931bc989d as bootable. {{(pid=87558) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Copying metadata from image 727e47d6-0f6c-48c1-bd4d-10f33e695e85 to c59656e4-c1e8-470e-bf48-ce9931bc989d. {{(pid=87558) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Creating volume glance metadata for volume c59656e4-c1e8-470e-bf48-ce9931bc989d backed by image 727e47d6-0f6c-48c1-bd4d-10f33e695e85 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '727e47d6-0f6c-48c1-bd4d-10f33e695e85', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '11decd7f617557a47a63f4147a448074', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87558) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 04:09:40 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4f1966-3739-4de8-858a-7bdbc376870e" returned: 0 in 0.488s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4f1966-3739-4de8-858a-7bdbc376870e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0b911f-24d9-4c46-8818-f8abe9729ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c59656e4-c1e8-470e-bf48-ce9931bc989d', 'volume_size': 1, 'image_id': '727e47d6-0f6c-48c1-bd4d-10f33e695e85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/727e47d6-0f6c-48c1-bd4d-10f33e695e85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '11decd7f617557a47a63f4147a448074', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6c8f8936d99468da4c11cb8a34087e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c6a1c24cb7019a4316fc58f7ccd75e22dee47f835d877d31e02eee6bc13ed3e4d351a426a7e3060ad7efaf59d8459ab4bd961076d7200517b4450828e6f3a970', 'id': '727e47d6-0f6c-48c1-bd4d-10f33e695e85', 'created_at': datetime.datetime(2026, 9, 9, 2, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 2, 9, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/727e47d6-0f6c-48c1-bd4d-10f33e695e85/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42c01b5730>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f173e33-cfbf-4afd-88eb-ac2a9ccc3f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:40 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4f1966-3739-4de8-858a-7bdbc376870e
Sep 09 04:09:40 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:40 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Volume volume-c59656e4-c1e8-470e-bf48-ce9931bc989d (c59656e4-c1e8-470e-bf48-ce9931bc989d): created successfully
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f173e33-cfbf-4afd-88eb-ac2a9ccc3f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Flow 'volume_create_manager' (2316ace7-8c30-45a3-a899-005ef665d9d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:40 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-180c0eaf-5f86-41b2-8086-6142172f9ed7 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Created volume successfully.
Sep 09 04:09:40 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1c074244-2784-4abf-9eb5-9c402d9b2554 1073741824" returned: 0 in 0.649s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:40 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-de4f1966-3739-4de8-858a-7bdbc376870e" returned: 0 in 0.409s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1c074244-2784-4abf-9eb5-9c402d9b2554 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-quobyte-de4f1966-3739-4de8-858a-7bdbc376870e" released by "delete_volume" :: held 0.964s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:41 devstack sudo[106225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1c074244-2784-4abf-9eb5-9c402d9b2554
Sep 09 04:09:41 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Acquiring lock "cinder-c59656e4-c1e8-470e-bf48-ce9931bc989d-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Lock "cinder-c59656e4-c1e8-470e-bf48-ce9931bc989d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Acquiring lock "cinder-quobyte-c59656e4-c1e8-470e-bf48-ce9931bc989d" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Created reservations ['79a0f21d-a54c-4f62-a0f7-d8c7776a0073', 'c48e8556-5c19-47a5-89c7-d0988395b751', '12ca3169-43ba-4622-9e7e-5966aff78669', '32056625-8113-4519-9653-f3833d4fb99d'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Lock "cinder-quobyte-c59656e4-c1e8-470e-bf48-ce9931bc989d" acquired by "delete_volume" :: waited 0.033s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2e744f-c5a2-4043-9f44-ef8063103157]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:41 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:41 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:41 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1c074244-2784-4abf-9eb5-9c402d9b2554" returned: 0 in 0.364s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.670s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1501533176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819b6cc9-cf24-4dd7-8601-8482d36ac14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436aa57f43604c5fab1455fa5071c5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:37Z,use_quota=True,user_id='fb59e441104e49e1addc458ff10d72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Creating volume 819b6cc9-cf24-4dd7-8601-8482d36ac14d {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:41 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a912c2-a91f-466d-b60e-7e1d277fa716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c074244-2784-4abf-9eb5-9c402d9b2554', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:41 devstack sudo[106231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d 1073741824
Sep 09 04:09:41 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fc3436-aa73-4c5b-a7c3-238a78621319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:41 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume volume-1c074244-2784-4abf-9eb5-9c402d9b2554 (1c074244-2784-4abf-9eb5-9c402d9b2554): created successfully
Sep 09 04:09:41 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d
Sep 09 04:09:41 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fc3436-aa73-4c5b-a7c3-238a78621319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Flow 'volume_create_manager' (6e4d18a7-0031-41be-a984-f45a99d72271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:41 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ecfe8664-ae01-4571-aee4-d6814e73a5ee tempest-CreateVolumesFromSnapshotTest-1025528933 None] Created volume successfully.
Sep 09 04:09:41 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.301s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:41 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Deleted volume successfully.
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e1056a25-4afd-46aa-87e3-31519393bce2 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-de4f1966-3739-4de8-858a-7bdbc376870e-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:41 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d" returned: 0 in 0.512s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:41 devstack sudo[106241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d
Sep 09 04:09:41 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:41 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d 1073741824" returned: 0 in 0.612s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:42 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-c59656e4-c1e8-470e-bf48-ce9931bc989d" returned: 0 in 0.291s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:42 devstack sudo[106245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d
Sep 09 04:09:42 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Lock "cinder-quobyte-c59656e4-c1e8-470e-bf48-ce9931bc989d" released by "delete_volume" :: held 0.871s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Created reservations ['99533929-d6a8-4f86-acf6-2dffa80f528e', 'b8dc2044-f426-4741-97df-411ccd899372', 'e86a6f2e-d989-431b-9da0-5d42eee8a060', '639ee5e7-2227-451e-bd81-9cad24abb667'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:42 devstack sudo[106247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:42 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "cinder-ca0ccf74-2909-4f80-8b14-4298faa51317-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:42 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d" returned: 0 in 0.389s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-ca0ccf74-2909-4f80-8b14-4298faa51317-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.357s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-900939246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197245f8-e094-4c7d-b1c7-ea5f079a65f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436aa57f43604c5fab1455fa5071c5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:37Z,use_quota=True,user_id='fb59e441104e49e1addc458ff10d72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Creating volume 197245f8-e094-4c7d-b1c7-ea5f079a65f7 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:42 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfa7e69-f86c-4521-bf23-1567f930f9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:42 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7 1073741824
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5066d989-4460-4cc4-a4fc-e4eb7b80774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:42 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:42 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d (819b6cc9-cf24-4dd7-8601-8482d36ac14d): created successfully
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5066d989-4460-4cc4-a4fc-e4eb7b80774f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Flow 'volume_create_manager' (a485b8b7-bacd-4ad0-bf55-f85920792464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "cinder-quobyte-ca0ccf74-2909-4f80-8b14-4298faa51317" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:42 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:42 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-addc34ed-a259-4c5a-93cc-7d49d0ae4a93 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Created volume successfully.
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.388s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:42 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Deleted volume successfully.
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-quobyte-ca0ccf74-2909-4f80-8b14-4298faa51317" acquired by "delete_volume" :: waited 0.050s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4795a7cf-0185-4416-8b7f-e7790e0cc838 tempest-VolumeAndVolumeTypeFromImageTest-1261428073 None] Lock "cinder-c59656e4-c1e8-470e-bf48-ce9931bc989d-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cf7db4-c459-43a0-973b-aee8e10df20d]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ca0ccf74-2909-4f80-8b14-4298faa51317 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:42 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ca0ccf74-2909-4f80-8b14-4298faa51317
Sep 09 04:09:42 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:43 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7 1073741824" returned: 0 in 0.593s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:43 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7
Sep 09 04:09:43 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:43 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ca0ccf74-2909-4f80-8b14-4298faa51317" returned: 0 in 0.497s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ca0ccf74-2909-4f80-8b14-4298faa51317 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:43 devstack sudo[106265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ca0ccf74-2909-4f80-8b14-4298faa51317
Sep 09 04:09:43 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:43 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7" returned: 0 in 0.337s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.943s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-427685061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928985e1-d0b6-413e-ad77-0054aa8cbdc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436aa57f43604c5fab1455fa5071c5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:37Z,use_quota=True,user_id='fb59e441104e49e1addc458ff10d72b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Creating volume 928985e1-d0b6-413e-ad77-0054aa8cbdc5 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:43 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:43 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2033d17a-cc75-4cc5-bb53-587a3f42c3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f654230-4332-4a6b-b952-ff523235b673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:43 devstack sudo[106269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5 1073741824
Sep 09 04:09:43 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-ca0ccf74-2909-4f80-8b14-4298faa51317" returned: 0 in 0.326s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-quobyte-ca0ccf74-2909-4f80-8b14-4298faa51317" released by "delete_volume" :: held 0.893s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:43 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7 (197245f8-e094-4c7d-b1c7-ea5f079a65f7): created successfully
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f654230-4332-4a6b-b952-ff523235b673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Flow 'volume_create_manager' (e4148418-95af-46c9-9dfb-04f6b3879fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:43 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f7fee0ce-9141-4bc7-988c-187ab15f8f36 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Created volume successfully.
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Flow 'volume_create_manager' (4c3c755b-01ee-4c15-b2d9-8a739c9cba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a236086-7bd2-44d8-9712-cca3badd1250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a236086-7bd2-44d8-9712-cca3badd1250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-934791485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15afd59b-3f2d-43c2-bb02-02caadc60d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1fbd1fa846b4abfb2694ca25c6c95f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:44Z,use_quota=True,user_id='95de84fed9034dd48ad7753480f21d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4648891b-2146-4eaf-836c-08e46ca77413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4648891b-2146-4eaf-836c-08e46ca77413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76b2288-5eac-4879-868a-8fe7282d8103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76b2288-5eac-4879-868a-8fe7282d8103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15afd59b-3f2d-43c2-bb02-02caadc60d04', 'volume_name': 'volume-15afd59b-3f2d-43c2-bb02-02caadc60d04', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9330b869-39f8-4e5c-938e-d0ba2d228b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9330b869-39f8-4e5c-938e-d0ba2d228b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e17cdd-ba2d-4185-8176-e40a0330f1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:43 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Volume 15afd59b-3f2d-43c2-bb02-02caadc60d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15afd59b-3f2d-43c2-bb02-02caadc60d04', 'volume_size': 1}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Created reservations ['c26ddc62-aa65-41b5-9f1b-41bc5576b536', '8cfb0c62-7ce2-476a-8e36-5464e12b8ad0', '3bb8551b-1f57-45c4-b2d8-2e1c8932a77e', '9e93f24a-328e-4512-9621-49e6f1db6ce3'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:43 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:43 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:44 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5 1073741824" returned: 0 in 0.568s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:44 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.301s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:44 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Deleted volume successfully.
Sep 09 04:09:44 devstack sudo[106278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5
Sep 09 04:09:44 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6a2ccbae-ab78-4057-aaaf-466ecdfeb7db tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-ca0ccf74-2909-4f80-8b14-4298faa51317-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:44 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5" returned: 0 in 0.295s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-934791485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15afd59b-3f2d-43c2-bb02-02caadc60d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1fbd1fa846b4abfb2694ca25c6c95f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:44Z,use_quota=True,user_id='95de84fed9034dd48ad7753480f21d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Creating volume 15afd59b-3f2d-43c2-bb02-02caadc60d04 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:44 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20839b35-512f-425a-a535-cbb5ee6453f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:44 devstack sudo[106281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 1073741824
Sep 09 04:09:44 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6f26bb-2c87-4ea9-9a5f-4894ef9cbfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:44 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Volume volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5 (928985e1-d0b6-413e-ad77-0054aa8cbdc5): created successfully
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6f26bb-2c87-4ea9-9a5f-4894ef9cbfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Flow 'volume_create_manager' (0e184bbf-3faa-4fcb-a180-377ed39a41ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:44 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-dd8f8c1b-8211-474c-a8c4-c0aa46f524b8 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Created volume successfully.
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "cinder-bbd9007d-ef9d-432c-b23d-583fcb3773b9-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-bbd9007d-ef9d-432c-b23d-583fcb3773b9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "cinder-quobyte-bbd9007d-ef9d-432c-b23d-583fcb3773b9" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-quobyte-bbd9007d-ef9d-432c-b23d-583fcb3773b9" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bfe94f-d2d6-4aee-ae3b-683b48f28fe4]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:44 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 1073741824" returned: 0 in 0.533s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:44 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9
Sep 09 04:09:44 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:45 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04
Sep 09 04:09:45 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:45 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9" returned: 0 in 0.465s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:45 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04" returned: 0 in 0.305s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e17cdd-ba2d-4185-8176-e40a0330f1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15afd59b-3f2d-43c2-bb02-02caadc60d04', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:45 devstack sudo[106295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9
Sep 09 04:09:45 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a71f36-4a28-48e7-8aaf-7240926c4915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:45 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Volume volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 (15afd59b-3f2d-43c2-bb02-02caadc60d04): created successfully
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a71f36-4a28-48e7-8aaf-7240926c4915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Flow 'volume_create_manager' (4c3c755b-01ee-4c15-b2d9-8a739c9cba1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-928985e1-d0b6-413e-ad77-0054aa8cbdc5-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:45 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-399421e4-1b38-483d-9578-3df786224644 tempest-VolumeDependencyTests-76697407 None] Created volume successfully.
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-928985e1-d0b6-413e-ad77-0054aa8cbdc5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-quobyte-928985e1-d0b6-413e-ad77-0054aa8cbdc5" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-928985e1-d0b6-413e-ad77-0054aa8cbdc5" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c3fef5-5b26-4d8a-9e0f-dd90c86e2386]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:45 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-bbd9007d-ef9d-432c-b23d-583fcb3773b9" returned: 0 in 0.351s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:45 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5
Sep 09 04:09:45 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-quobyte-bbd9007d-ef9d-432c-b23d-583fcb3773b9" released by "delete_volume" :: held 0.878s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Created reservations ['350a4761-ecb0-4416-aabe-dead60867221', '2b229f41-2eb2-4d5d-ade9-3f29b4410dcf', '99b31480-384d-4a90-a94a-0098a96ed219', '098f9511-0b06-4fd6-9083-55888f95247e'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "cinder-fd4e6c8b-b716-4f92-b93c-4480c0486301-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:45 devstack sudo[106303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:45 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] Creating offline snapshot c672cc8f-3161-404e-9a03-e1c32c918d5e of volume 15afd59b-3f2d-43c2-bb02-02caadc60d04 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-fd4e6c8b-b716-4f92-b93c-4480c0486301-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf23ee2-b8b2-4859-a07a-ba622d0d1712]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:46 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5" returned: 0 in 0.566s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "cinder-quobyte-fd4e6c8b-b716-4f92-b93c-4480c0486301" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-quobyte-fd4e6c8b-b716-4f92-b93c-4480c0486301" acquired by "delete_volume" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:46 devstack sudo[106307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5
Sep 09 04:09:46 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97d2831-8ae4-461f-a3f7-102d2e743c4e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4e6c8b-b716-4f92-b93c-4480c0486301 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:46 devstack sudo[106306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04
Sep 09 04:09:46 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:46 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4e6c8b-b716-4f92-b93c-4480c0486301
Sep 09 04:09:46 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:46 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.395s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:46 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Deleted volume successfully.
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-43b135bc-862c-4618-92b7-75454a0400de tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-bbd9007d-ef9d-432c-b23d-583fcb3773b9-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:46 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-928985e1-d0b6-413e-ad77-0054aa8cbdc5" returned: 0 in 0.346s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-928985e1-d0b6-413e-ad77-0054aa8cbdc5" released by "delete_volume" :: held 0.973s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Created reservations ['264429db-8edd-427e-87e4-c000ee1cd4cb', 'a46eced5-4586-45d7-999b-ff2a18471268', '9e4386c2-807f-46e6-93de-d02c85a2e798', 'f17c3b2a-a1c4-419e-9dab-81d7f34b10f5'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:46 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04" returned: 0 in 0.542s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:46 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:46 devstack sudo[106321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e 1G
Sep 09 04:09:46 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4e6c8b-b716-4f92-b93c-4480c0486301" returned: 0 in 0.480s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4e6c8b-b716-4f92-b93c-4480c0486301 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:46 devstack sudo[106322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:46 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:46 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4e6c8b-b716-4f92-b93c-4480c0486301
Sep 09 04:09:46 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:46 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fd4e6c8b-b716-4f92-b93c-4480c0486301" returned: 0 in 0.307s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:46 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.335s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-quobyte-fd4e6c8b-b716-4f92-b93c-4480c0486301" released by "delete_volume" :: held 0.841s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:46 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Deleted volume successfully.
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fa1deb77-6723-4696-91db-6aedc5f2a17e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-928985e1-d0b6-413e-ad77-0054aa8cbdc5-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Created reservations ['3331a7d1-cff5-4e5c-aea6-8eb549812193', '07a1c134-de69-48d2-87f5-360fc3254963', '74cdc2ce-b112-4867-9fe7-a031222440a0', 'd7f14d87-0e44-4acb-9337-3b52950d691f'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:47 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e 1G" returned: 0 in 0.469s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:47 devstack sudo[106333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e
Sep 09 04:09:47 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:47 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:47 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "cinder-7e728153-84c1-4669-996d-d1ac37dfafb0-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-7e728153-84c1-4669-996d-d1ac37dfafb0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "cinder-quobyte-7e728153-84c1-4669-996d-d1ac37dfafb0" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-quobyte-7e728153-84c1-4669-996d-d1ac37dfafb0" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac80ac9e-8c5f-40a0-917a-a6b3621d1632]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7e728153-84c1-4669-996d-d1ac37dfafb0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:47 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e" returned: 0 in 0.353s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:47 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e is being set with open permissions: ugo+rw
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:47 devstack sudo[106342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e
Sep 09 04:09:47 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:47 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.310s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:47 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Deleted volume successfully.
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-261a4fa9-3554-4ef4-a61f-25ef797e4d4a tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-fd4e6c8b-b716-4f92-b93c-4480c0486301-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:47 devstack sudo[106340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7e728153-84c1-4669-996d-d1ac37dfafb0
Sep 09 04:09:47 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-197245f8-e094-4c7d-b1c7-ea5f079a65f7-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-197245f8-e094-4c7d-b1c7-ea5f079a65f7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:47 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e" returned: 0 in 0.361s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-quobyte-197245f8-e094-4c7d-b1c7-ea5f079a65f7" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:47 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7e728153-84c1-4669-996d-d1ac37dfafb0" returned: 0 in 0.449s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7e728153-84c1-4669-996d-d1ac37dfafb0 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-197245f8-e094-4c7d-b1c7-ea5f079a65f7" acquired by "delete_volume" :: waited 0.035s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:47 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7e728153-84c1-4669-996d-d1ac37dfafb0
Sep 09 04:09:47 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6db0c76-de41-4ef4-9b22-fe1d9d8b958b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:47 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.info
Sep 09 04:09:47 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:47 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7
Sep 09 04:09:47 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:48 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7e728153-84c1-4669-996d-d1ac37dfafb0" returned: 0 in 0.328s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-quobyte-7e728153-84c1-4669-996d-d1ac37dfafb0" released by "delete_volume" :: held 0.823s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Created reservations ['67fa5da6-aeae-4404-9c46-035f06fc6767', '9fc5e370-cc6c-48b8-ad08-5701c81b99ea', '007f2fb9-e126-4110-bc08-6179bd6bc7d9', '52c92eb7-700f-4e67-a36d-985484cf8fb8'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:48 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.info" returned: 0 in 0.358s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:48 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.info is being set with open permissions: ugo+rw
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:48 devstack sudo[106360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.info
Sep 09 04:09:48 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:48 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7" returned: 0 in 0.481s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:48 devstack sudo[106363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:48 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:48 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7
Sep 09 04:09:48 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "cinder-5012fe54-5852-4684-9264-37f5f3713d0d-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-5012fe54-5852-4684-9264-37f5f3713d0d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "cinder-quobyte-5012fe54-5852-4684-9264-37f5f3713d0d" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:48 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.info" returned: 0 in 0.367s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-quobyte-5012fe54-5852-4684-9264-37f5f3713d0d" acquired by "delete_volume" :: waited 0.054s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:48 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.366s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[804dfb37-8a58-41ed-be94-c31a9cb6d710]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5012fe54-5852-4684-9264-37f5f3713d0d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:48 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Deleted volume successfully.
Sep 09 04:09:48 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-db614246-2efc-4369-9668-abe43eb5749a tempest-VolumeDependencyTests-76697407 None] Create snapshot completed successfully
Sep 09 04:09:48 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-197245f8-e094-4c7d-b1c7-ea5f079a65f7" returned: 0 in 0.386s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-105ffdff-4480-4c83-ae10-efc92895510e tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-7e728153-84c1-4669-996d-d1ac37dfafb0-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-197245f8-e094-4c7d-b1c7-ea5f079a65f7" released by "delete_volume" :: held 0.938s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Created reservations ['eb4e83e2-12a8-4f92-9f68-c3d41ed27ada', '3b7911a6-4c49-42f8-9d68-c6457416c087', '4a94626b-db16-45d0-b38f-e3cbbdca065d', '76a37577-a195-45b9-9d78-28447c22bb28'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:48 devstack sudo[106370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5012fe54-5852-4684-9264-37f5f3713d0d
Sep 09 04:09:48 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:48 devstack sudo[106372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:48 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:49 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5012fe54-5852-4684-9264-37f5f3713d0d" returned: 0 in 0.462s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5012fe54-5852-4684-9264-37f5f3713d0d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:49 devstack sudo[106377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5012fe54-5852-4684-9264-37f5f3713d0d
Sep 09 04:09:49 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:49 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.305s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:49 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Deleted volume successfully.
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c712d155-cf84-4589-a59e-fc9b3baaec2c tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-197245f8-e094-4c7d-b1c7-ea5f079a65f7-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:49 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-5012fe54-5852-4684-9264-37f5f3713d0d" returned: 0 in 0.292s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-quobyte-5012fe54-5852-4684-9264-37f5f3713d0d" released by "delete_volume" :: held 0.816s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Created reservations ['d5e8c17f-63ee-4944-921a-42ecbf84c59c', '7438b550-c5d8-475e-be46-100e7f1e9736', 'e9d4d72d-dff9-4e8b-92f4-afd3333f2103', '21ef9ce8-14ae-4b55-a1bf-3b52027ed5f4'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:49 devstack sudo[106381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:49 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Flow 'volume_create_manager' (01950f24-eb2c-4727-b7d6-700423bb3166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9136a1-b04d-4ce6-9d64-77b7dae5b06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9136a1-b04d-4ce6-9d64-77b7dae5b06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1881524853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bdb3fdc-f41f-4736-8df3-2511c40d1e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1fbd1fa846b4abfb2694ca25c6c95f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c672cc8f-3161-404e-9a03-e1c32c918d5e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:50Z,use_quota=True,user_id='95de84fed9034dd48ad7753480f21d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0a3156-bb02-4adf-a897-c1f4781aa5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0a3156-bb02-4adf-a897-c1f4781aa5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524e1ea8-d51c-417f-9544-85f8c60b42c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524e1ea8-d51c-417f-9544-85f8c60b42c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7bdb3fdc-f41f-4736-8df3-2511c40d1e4b', 'volume_name': 'volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b', 'volume_size': 1, 'snapshot_id': 'c672cc8f-3161-404e-9a03-e1c32c918d5e'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb392434-aad2-4706-b680-08ff852d2651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb392434-aad2-4706-b680-08ff852d2651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3944e49b-7454-4701-bf23-c87f5b7cd23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:49 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Volume 7bdb3fdc-f41f-4736-8df3-2511c40d1e4b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b', 'volume_size': 1, 'snapshot_id': 'c672cc8f-3161-404e-9a03-e1c32c918d5e'}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Acquiring lock "cinder-quobyte-c672cc8f-3161-404e-9a03-e1c32c918d5e-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b" by "_create_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:49 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.322s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Lock "cinder-quobyte-c672cc8f-3161-404e-9a03-e1c32c918d5e-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Creating volume 7bdb3fdc-f41f-4736-8df3-2511c40d1e4b from snapshot c672cc8f-3161-404e-9a03-e1c32c918d5e {{(pid=87558) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Acquiring lock "cinder-quobyte-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b" by "_copy_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:50 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Deleted volume successfully.
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-819b6cc9-cf24-4dd7-8601-8482d36ac14d-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Lock "cinder-quobyte-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] snapshot: c672cc8f-3161-404e-9a03-e1c32c918d5e, volume: 7bdb3fdc-f41f-4736-8df3-2511c40d1e4b,  {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1c507ce0-5db7-43ee-b0f9-fed0d79c62c4 tempest-CreateVolumesFromSourceVolumeTest-337602597 None] Lock "cinder-5012fe54-5852-4684-9264-37f5f3713d0d-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-819b6cc9-cf24-4dd7-8601-8482d36ac14d-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[43266496-0e89-449f-8dc7-c364b60a9ef9]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-quobyte-819b6cc9-cf24-4dd7-8601-8482d36ac14d" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-819b6cc9-cf24-4dd7-8601-8482d36ac14d" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca21e21-9e51-4af0-a7ad-517a599e050c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:50 devstack sudo[106384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e
Sep 09 04:09:50 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:50 devstack sudo[106385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d
Sep 09 04:09:50 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:50 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e" returned: 0 in 0.485s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15afd59b-3f2d-43c2-bb02-02caadc60d04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[483136fa-6d04-4a2b-ae74-5451bff99421]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:50 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d" returned: 0 in 0.520s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:50 devstack sudo[106393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04
Sep 09 04:09:50 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:50 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d
Sep 09 04:09:50 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:51 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-819b6cc9-cf24-4dd7-8601-8482d36ac14d" returned: 0 in 0.313s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:51 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04" returned: 0 in 0.447s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Creating direct copy from snapshot {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG cinder.utils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Path /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b not found in is_blk_device check {{(pid=87558) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-819b6cc9-cf24-4dd7-8601-8482d36ac14d" released by "delete_volume" :: held 0.903s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:51 devstack sudo[106404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b
Sep 09 04:09:51 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Created reservations ['75d0f557-6805-4876-ac2a-12421ed4f012', '021f6ab8-68ae-4e6e-8a47-9cca7ffd262f', 'c21cce19-9324-4158-b43a-c0c74cf32109', '217d8763-cb47-4e8c-856c-e30c64f30580'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:51 devstack sudo[106406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:51 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:51 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.304s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Deleted volume successfully.
Sep 09 04:09:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-eaa5360a-a92f-403d-813b-c91fccc4b660 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-819b6cc9-cf24-4dd7-8601-8482d36ac14d-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-1c074244-2784-4abf-9eb5-9c402d9b2554-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-1c074244-2784-4abf-9eb5-9c402d9b2554-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-quobyte-1c074244-2784-4abf-9eb5-9c402d9b2554" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-1c074244-2784-4abf-9eb5-9c402d9b2554" acquired by "delete_volume" :: waited 0.053s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:52 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[977e0cf5-7f20-4323-a3a4-2839b8cbcbb8]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1c074244-2784-4abf-9eb5-9c402d9b2554 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:53 devstack sudo[106420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1c074244-2784-4abf-9eb5-9c402d9b2554
Sep 09 04:09:53 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:53 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1c074244-2784-4abf-9eb5-9c402d9b2554" returned: 0 in 1.110s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1c074244-2784-4abf-9eb5-9c402d9b2554 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:53 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1c074244-2784-4abf-9eb5-9c402d9b2554
Sep 09 04:09:53 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:54 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-1c074244-2784-4abf-9eb5-9c402d9b2554" returned: 0 in 0.640s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:54 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-1c074244-2784-4abf-9eb5-9c402d9b2554" released by "delete_volume" :: held 1.887s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:54 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Created reservations ['389498db-6960-4b8c-9eb2-b311ecba526f', 'b8e7ee33-5c44-4a09-9c80-599bf93fe683', 'e24a090a-597e-40b1-ac6f-17b3d2737971', '5e27d69f-aab2-4690-83e4-ff97ca07b504'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:55 devstack sudo[106430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:55 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-6660b622-a4ca-46d9-b5ab-306d52c3da79-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-6660b622-a4ca-46d9-b5ab-306d52c3da79-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-quobyte-6660b622-a4ca-46d9-b5ab-306d52c3da79" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:55 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.466s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-6660b622-a4ca-46d9-b5ab-306d52c3da79" acquired by "delete_volume" :: waited 0.060s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:55 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Deleted volume successfully.
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b036c5f2-98b0-4741-b7af-6538872cf2b7]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6660b622-a4ca-46d9-b5ab-306d52c3da79 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:55 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a28e0cf0-c5c7-4cab-8412-e92ddf2bc818 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-1c074244-2784-4abf-9eb5-9c402d9b2554-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:55 devstack sudo[106434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6660b622-a4ca-46d9-b5ab-306d52c3da79
Sep 09 04:09:55 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Flow 'volume_create_manager' (7716b761-2a2e-4d81-845f-0be8a465fade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a859a0e-0d74-4dfc-a8f7-9542574df978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a859a0e-0d74-4dfc-a8f7-9542574df978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef9ce03a149459d9740e0fe9535ca1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:56Z,use_quota=True,user_id='cee0e2ee43354cb7a03eda59605976c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c037a844-2c3e-4ce7-b79d-64f50f12cdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c037a844-2c3e-4ce7-b79d-64f50f12cdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29e00b1-782d-4f4d-9ba9-ca0044d0de9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29e00b1-782d-4f4d-9ba9-ca0044d0de9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f', 'volume_name': 'volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f55de2f-c2f9-4b13-ab5b-624b263d6d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f55de2f-c2f9-4b13-ab5b-624b263d6d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecf3a88-2e8e-4f12-8c59-4f277b227dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:56 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Volume f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f', 'volume_size': 1}
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:56 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6660b622-a4ca-46d9-b5ab-306d52c3da79" returned: 0 in 1.147s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6660b622-a4ca-46d9-b5ab-306d52c3da79 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:56 devstack sudo[106439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6660b622-a4ca-46d9-b5ab-306d52c3da79
Sep 09 04:09:56 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:57 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b" returned: 0 in 6.222s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 04:09:57 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Converted 1024.00 MB image at 164.56 MB/s
Sep 09 04:09:57 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b is being set with open permissions: ugo+rw
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:57 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6660b622-a4ca-46d9-b5ab-306d52c3da79" returned: 0 in 0.597s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:57 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b
Sep 09 04:09:57 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-6660b622-a4ca-46d9-b5ab-306d52c3da79" released by "delete_volume" :: held 1.861s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Created reservations ['7c62f6e4-e81f-4d76-b32f-7fb519063a46', '67c4946c-36a3-45ca-bf48-9b53e22008d1', 'c09f5189-701c-4f7d-987c-2696e065e489', '8086701b-26a9-443b-9753-7fcb43c582dd'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:57 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:09:57 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:57 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b" returned: 0 in 0.257s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Lock "cinder-quobyte-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b" released by "_copy_volume_from_snapshot" :: held 7.576s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Lock "cinder-quobyte-c672cc8f-3161-404e-9a03-e1c32c918d5e-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b" released by "_create_volume_from_snapshot" :: held 7.685s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.729s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.967s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef9ce03a149459d9740e0fe9535ca1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:56Z,use_quota=True,user_id='cee0e2ee43354cb7a03eda59605976c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Creating volume f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:57 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3944e49b-7454-4701-bf23-c87f5b7cd23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b', 'volume_size': 1, 'snapshot_id': 'c672cc8f-3161-404e-9a03-e1c32c918d5e'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e97fd6-9f86-466d-a97e-0f87f22d4112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:57 devstack sudo[106447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f 1073741824
Sep 09 04:09:57 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:57 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Volume volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b (7bdb3fdc-f41f-4736-8df3-2511c40d1e4b): created successfully
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e97fd6-9f86-466d-a97e-0f87f22d4112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Flow 'volume_create_manager' (01950f24-eb2c-4727-b7d6-700423bb3166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:57 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.286s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:09:57 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Deleted volume successfully.
Sep 09 04:09:57 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9dc9e4ef-4a4a-480e-b73d-f6a9959e90cd tempest-VolumeDependencyTests-76697407 None] Created volume successfully.
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-fcf78b11-93a8-4282-aa75-1fcd7cab704e tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-6660b622-a4ca-46d9-b5ab-306d52c3da79-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-23aebbba-a631-4bdc-b79f-0826a0297ee7-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-23aebbba-a631-4bdc-b79f-0826a0297ee7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-quobyte-a192a0f2-ab1c-4cdc-b594-9442b60c2799" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-a192a0f2-ab1c-4cdc-b594-9442b60c2799" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-quobyte-23aebbba-a631-4bdc-b79f-0826a0297ee7" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-23aebbba-a631-4bdc-b79f-0826a0297ee7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Deleting offline snapshot 23aebbba-a631-4bdc-b79f-0826a0297ee7 of volume a192a0f2-ab1c-4cdc-b594-9442b60c2799 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:09:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] snapshot_file for this snap is: volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[24383c05-2596-4a42-94d4-1aac184c8c01]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:09:58 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7
Sep 09 04:09:58 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (0d69c278-434c-407a-b547-44a58a083264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11131e54-9bcd-43d6-84c7-565dcba11b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11131e54-9bcd-43d6-84c7-565dcba11b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224720735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fdf3bd5-06fb-4e6e-b695-ab23f1084330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:58Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc481c3-7005-4957-8b22-21ed73583d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc481c3-7005-4957-8b22-21ed73583d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7460d004-59cb-487d-8563-3927f218b325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7460d004-59cb-487d-8563-3927f218b325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fdf3bd5-06fb-4e6e-b695-ab23f1084330', 'volume_name': 'volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4f576c-49ce-4612-93f9-9ad0dd4c96c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4f576c-49ce-4612-93f9-9ad0dd4c96c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d48a90-46b5-4f3a-bba9-82da9b0495e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:58 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Volume 7fdf3bd5-06fb-4e6e-b695-ab23f1084330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330', 'volume_size': 1}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:58 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f 1073741824" returned: 0 in 0.531s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:58 devstack sudo[106456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f
Sep 09 04:09:58 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:58 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7" returned: 0 in 0.388s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[8505f049-d7c7-4328-961e-c4c1b409c3c1]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:58 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f" returned: 0 in 0.270s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.337s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224720735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fdf3bd5-06fb-4e6e-b695-ab23f1084330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:09:58Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Creating volume 7fdf3bd5-06fb-4e6e-b695-ab23f1084330 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:09:58 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:58 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799
Sep 09 04:09:58 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecf3a88-2e8e-4f12-8c59-4f277b227dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3135b4-8443-4735-80ac-41a19148dbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:58 devstack sudo[106464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330 1073741824
Sep 09 04:09:58 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:58 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Volume volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f (f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f): created successfully
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3135b4-8443-4735-80ac-41a19148dbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Flow 'volume_create_manager' (7716b761-2a2e-4d81-845f-0be8a465fade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:58 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c9098ec3-00a2-4383-8f3f-73b33205fc67 tempest-CinderUnicodeTest-1631581929 None] Created volume successfully.
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Acquiring lock "cinder-c672cc8f-3161-404e-9a03-e1c32c918d5e-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-c672cc8f-3161-404e-9a03-e1c32c918d5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Acquiring lock "cinder-quobyte-15afd59b-3f2d-43c2-bb02-02caadc60d04" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-quobyte-15afd59b-3f2d-43c2-bb02-02caadc60d04" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Acquiring lock "cinder-quobyte-c672cc8f-3161-404e-9a03-e1c32c918d5e" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-quobyte-c672cc8f-3161-404e-9a03-e1c32c918d5e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Deleting offline snapshot c672cc8f-3161-404e-9a03-e1c32c918d5e of volume 15afd59b-3f2d-43c2-bb02-02caadc60d04 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] snapshot_file for this snap is: volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68f7554-a64f-492d-98ff-61e5e56a27f8]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:58 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799" returned: 0 in 0.502s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:58 devstack sudo[106474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7
Sep 09 04:09:58 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:59 devstack sudo[106473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e
Sep 09 04:09:59 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:59 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330 1073741824" returned: 0 in 0.573s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:59 devstack sudo[106480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330
Sep 09 04:09:59 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:59 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7" returned: 0 in 0.368s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:59 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e" returned: 0 in 0.408s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15afd59b-3f2d-43c2-bb02-02caadc60d04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:09:59 devstack sudo[106486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7
Sep 09 04:09:59 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8667214-f72c-4335-a4ec-ad26e9965be2]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:59 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330" returned: 0 in 0.254s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d48a90-46b5-4f3a-bba9-82da9b0495e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322c91fb-4830-4477-b244-7444163c1002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:09:59 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04
Sep 09 04:09:59 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:09:59 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Volume volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330 (7fdf3bd5-06fb-4e6e-b695-ab23f1084330): created successfully
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322c91fb-4830-4477-b244-7444163c1002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (0d69c278-434c-407a-b547-44a58a083264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:09:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-77642c9b-9dea-493c-aa08-e8ecb219310a tempest-ProjectMemberTests-1716548698 None] Created volume successfully.
Sep 09 04:09:59 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799.23aebbba-a631-4bdc-b79f-0826a0297ee7" returned: 0 in 0.285s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-23aebbba-a631-4bdc-b79f-0826a0297ee7" released by "_delete_snapshot" :: held 1.686s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-a192a0f2-ab1c-4cdc-b594-9442b60c2799" released by "delete_snapshot" :: held 1.717s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Created reservations ['92a4a66a-257b-4068-a170-81301d60a339', 'b3df2f70-5017-4c4b-9f72-b3018775acf5', '065db8e4-22ca-4311-abdd-340409d28d1e', '64ddca1a-4f07-48eb-850f-cbf812f37786'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:09:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Delete snapshot completed successfully.
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-12d1f2b6-d367-479e-a5d1-2f7fa4282feb tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-23aebbba-a631-4bdc-b79f-0826a0297ee7-delete_snapshot" released by "delete_snapshot" :: held 1.867s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:09:59 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04" returned: 0 in 0.582s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:09:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:09:59 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e
Sep 09 04:09:59 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-a192a0f2-ab1c-4cdc-b594-9442b60c2799-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-a192a0f2-ab1c-4cdc-b594-9442b60c2799-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "cinder-quobyte-a192a0f2-ab1c-4cdc-b594-9442b60c2799" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Flow 'volume_create_manager' (4cc09cb8-d63f-4f8e-964b-82a90bb8bd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ad30f7-659a-4917-b2e0-9522b1f42f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-a192a0f2-ab1c-4cdc-b594-9442b60c2799" acquired by "delete_volume" :: waited 0.054s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ad30f7-659a-4917-b2e0-9522b1f42f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2056350492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02b0028-d05b-4214-9cdd-d1dfb4095429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef9ce03a149459d9740e0fe9535ca1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:00Z,use_quota=True,user_id='cee0e2ee43354cb7a03eda59605976c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8547313-169e-441c-aa0c-7ee2454fc5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8547313-169e-441c-aa0c-7ee2454fc5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5eba5d-897a-4aab-8cf4-1210e8f8dcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5eba5d-897a-4aab-8cf4-1210e8f8dcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd02b0028-d05b-4214-9cdd-d1dfb4095429', 'volume_name': 'volume-d02b0028-d05b-4214-9cdd-d1dfb4095429', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b290d155-95d5-49f0-84a6-4511d963857f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b290d155-95d5-49f0-84a6-4511d963857f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd85344-a355-43cc-9825-a522cce3dc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:00 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Volume d02b0028-d05b-4214-9cdd-d1dfb4095429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d02b0028-d05b-4214-9cdd-d1dfb4095429', 'volume_size': 1}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2056350492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02b0028-d05b-4214-9cdd-d1dfb4095429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef9ce03a149459d9740e0fe9535ca1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:00Z,use_quota=True,user_id='cee0e2ee43354cb7a03eda59605976c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Creating volume d02b0028-d05b-4214-9cdd-d1dfb4095429 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:00 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:00 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d8150f-e95e-42b0-909b-639cdb15f43f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e" returned: 0 in 0.437s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:00 devstack sudo[106500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429 1073741824
Sep 09 04:10:00 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:00 devstack sudo[106503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e
Sep 09 04:10:00 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:00 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799
Sep 09 04:10:00 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:00 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04.c672cc8f-3161-404e-9a03-e1c32c918d5e" returned: 0 in 0.331s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-quobyte-c672cc8f-3161-404e-9a03-e1c32c918d5e" released by "_delete_snapshot" :: held 1.870s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-quobyte-15afd59b-3f2d-43c2-bb02-02caadc60d04" released by "delete_snapshot" :: held 1.901s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Created reservations ['d58c9dcc-f67a-4aee-b8c2-ba8224c3aeb3', '92b9e71c-5e3b-4363-8d0e-ef0a5b9d511c', '40726e61-4d6f-43d0-9259-8e16fb365a02', 'c426703d-a9f0-4921-ac98-f74d57dad035'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:00 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:00 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799" returned: 0 in 0.474s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429 1073741824" returned: 0 in 0.505s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:00 devstack sudo[106514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799
Sep 09 04:10:00 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:00 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Delete snapshot completed successfully.
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ed9a7b31-7fcd-4a3d-a1fc-e7921065f133 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-c672cc8f-3161-404e-9a03-e1c32c918d5e-delete_snapshot" released by "delete_snapshot" :: held 2.114s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:00 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429
Sep 09 04:10:00 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Acquiring lock "cinder-15afd59b-3f2d-43c2-bb02-02caadc60d04-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-15afd59b-3f2d-43c2-bb02-02caadc60d04-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Acquiring lock "cinder-quobyte-15afd59b-3f2d-43c2-bb02-02caadc60d04" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-quobyte-15afd59b-3f2d-43c2-bb02-02caadc60d04" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:01 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a192a0f2-ab1c-4cdc-b594-9442b60c2799" returned: 0 in 0.307s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc530cf-5f22-4ce9-bf9f-a5df42fadd87]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-quobyte-a192a0f2-ab1c-4cdc-b594-9442b60c2799" released by "delete_volume" :: held 0.929s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Created reservations ['e58b53dd-f7c1-4c71-a6bf-d2ea1bf6df2f', 'df4635b0-7532-441c-bec1-631146267f26', '8d634fc1-d5b1-4d37-b432-f0839fbc8dd4', 'ee7225f3-8790-4270-b64e-31b48289fc3f'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:01 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429" returned: 0 in 0.337s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.646s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd85344-a355-43cc-9825-a522cce3dc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d02b0028-d05b-4214-9cdd-d1dfb4095429', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9695da7-43bc-4aef-b8e8-609b2b2ae38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] Creating offline snapshot 53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6 of volume 7fdf3bd5-06fb-4e6e-b695-ab23f1084330 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:10:01 devstack sudo[106519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04
Sep 09 04:10:01 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[541f5291-7908-426b-b20d-acee38b6d9aa]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:01 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Volume volume-d02b0028-d05b-4214-9cdd-d1dfb4095429 (d02b0028-d05b-4214-9cdd-d1dfb4095429): created successfully
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9695da7-43bc-4aef-b8e8-609b2b2ae38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Flow 'volume_create_manager' (4cc09cb8-d63f-4f8e-964b-82a90bb8bd5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:01 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-33518174-4048-4db9-8c9c-d1cfb41f593c tempest-CinderUnicodeTest-1631581929 None] Created volume successfully.
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:01 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:01 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:01 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330
Sep 09 04:10:01 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:01 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04" returned: 0 in 0.393s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:01 devstack sudo[106529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04
Sep 09 04:10:01 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:01 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.270s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:01 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Deleted volume successfully.
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ce415d91-045e-48fa-b32f-484ce44949a0 tempest-CreateVolumesFromSnapshotTest-1025528933 None] Lock "cinder-a192a0f2-ab1c-4cdc-b594-9442b60c2799-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:01 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330" returned: 0 in 0.394s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:01 devstack sudo[106535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6 1G
Sep 09 04:10:01 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:01 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-15afd59b-3f2d-43c2-bb02-02caadc60d04" returned: 0 in 0.278s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-quobyte-15afd59b-3f2d-43c2-bb02-02caadc60d04" released by "delete_volume" :: held 0.730s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:01 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Created reservations ['c866290e-34e8-4580-841e-16bef7d318a2', 'a3bc3cb0-1a50-4ada-9768-7f6c55e242bd', '3cc30ede-0438-48c1-8478-57a370eddd8b', '1fd93cf8-8012-4a4b-b818-bef4c02b4efb'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:02 devstack sudo[106541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:02 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:02 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6 1G" returned: 0 in 0.452s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:02 devstack sudo[106543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6
Sep 09 04:10:02 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Acquiring lock "cinder-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Acquiring lock "cinder-quobyte-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-quobyte-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b" acquired by "delete_volume" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:02 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.373s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:02 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Deleted volume successfully.
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6728950f-c233-4a8c-9104-9660b886ec2f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-21b12c96-f16c-4cd6-b0cf-54b4a609fca8 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-15afd59b-3f2d-43c2-bb02-02caadc60d04-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:02 devstack sudo[106546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b
Sep 09 04:10:02 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:02 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6" returned: 0 in 0.462s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:02 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6 is being set with open permissions: ugo+rw
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:02 devstack sudo[106551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6
Sep 09 04:10:02 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:02 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b" returned: 0 in 0.443s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:02 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6" returned: 0 in 0.262s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:02 devstack sudo[106557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b
Sep 09 04:10:02 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:02 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.info
Sep 09 04:10:02 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:03 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b" returned: 0 in 0.303s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-quobyte-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b" released by "delete_volume" :: held 0.817s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:03 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.info" returned: 0 in 0.276s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:03 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.info is being set with open permissions: ugo+rw
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:03 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.info
Sep 09 04:10:03 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Created reservations ['bc420aa2-1af6-4e20-a781-6999d27b84cd', 'c80c1103-5801-49d3-b006-5389c67c37d5', 'f7b79885-0c77-4d79-afdd-bcffd1962774', '7c800490-c3ca-4173-ba1d-219379667afa'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:03 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:03 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:03 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.info" returned: 0 in 0.291s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.894s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] Creating offline snapshot 7b516528-bef2-4307-9816-c01f3d7f8162 of volume d02b0028-d05b-4214-9cdd-d1dfb4095429 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be22933-8c12-47b0-a05f-07df07347fc1]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:03 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-742dd8f7-5ad9-4ac5-aa5d-31963f0f2b89 tempest-ProjectMemberTests-1716548698 None] Create snapshot completed successfully
Sep 09 04:10:03 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.322s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:03 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Deleted volume successfully.
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-c7139be0-3219-45a4-a617-b68cf6920321 tempest-VolumeDependencyTests-76697407 None] Lock "cinder-7bdb3fdc-f41f-4736-8df3-2511c40d1e4b-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:03 devstack sudo[106568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429
Sep 09 04:10:03 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-7fdf3bd5-06fb-4e6e-b695-ab23f1084330" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-7fdf3bd5-06fb-4e6e-b695-ab23f1084330" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:03 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Deleting offline snapshot 53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6 of volume 7fdf3bd5-06fb-4e6e-b695-ab23f1084330 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:10:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] snapshot_file for this snap is: volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:10:04 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb5019d-f3ff-4ecc-92e6-31d9619d2ca7]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:04 devstack sudo[106572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6
Sep 09 04:10:04 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:04 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429" returned: 0 in 0.593s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:04 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162 1G
Sep 09 04:10:04 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:04 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6" returned: 0 in 0.483s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:10:04 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8cd6ff-4eb5-4c3c-890c-34e5a8f7b834]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:04 devstack sudo[106585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330
Sep 09 04:10:04 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:04 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162 1G" returned: 0 in 0.507s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02b0028-d05b-4214-9cdd-d1dfb4095429 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:04 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02b0028-d05b-4214-9cdd-d1dfb4095429 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162
Sep 09 04:10:04 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:05 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330" returned: 0 in 0.477s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:05 devstack sudo[106596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6
Sep 09 04:10:05 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:05 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02b0028-d05b-4214-9cdd-d1dfb4095429 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162" returned: 0 in 0.427s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:05 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162 is being set with open permissions: ugo+rw
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:05 devstack sudo[106598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162
Sep 09 04:10:05 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:05 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162" returned: 0 in 0.308s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:05 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6" returned: 0 in 0.443s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:05 devstack sudo[106606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6
Sep 09 04:10:05 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:05 devstack sudo[106608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.info
Sep 09 04:10:05 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:05 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330.53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6" returned: 0 in 0.307s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:05 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.info" returned: 0 in 0.334s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:05 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.info is being set with open permissions: ugo+rw
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6" released by "_delete_snapshot" :: held 1.868s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-7fdf3bd5-06fb-4e6e-b695-ab23f1084330" released by "delete_snapshot" :: held 1.916s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:05 devstack sudo[106612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.info
Sep 09 04:10:05 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:05 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Created reservations ['dc7ad736-252c-4e34-a526-b4d44aaaafa9', 'a44ae95a-841f-4f2b-b5d3-d18be91bd173', 'a2158b5f-ddb9-4c64-b78e-76a36cca62fa', 'c60267d1-a233-4289-a575-722ffaa048a2'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:06 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Delete snapshot completed successfully.
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9ef6a595-1522-4659-81db-402c700e04c8 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-53fe2de5-7ddc-4ed4-aa55-6c91c3d6a6b6-delete_snapshot" released by "delete_snapshot" :: held 2.141s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-7fdf3bd5-06fb-4e6e-b695-ab23f1084330-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-7fdf3bd5-06fb-4e6e-b695-ab23f1084330-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:06 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.info" returned: 0 in 0.365s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.666s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:06 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0747c9e1-1c9b-436d-9b09-9c5d01e51708 tempest-CinderUnicodeTest-1631581929 None] Create snapshot completed successfully
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-7fdf3bd5-06fb-4e6e-b695-ab23f1084330" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-7fdf3bd5-06fb-4e6e-b695-ab23f1084330" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47b876d-4b25-4f8e-afba-6e53d6b24fa2]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:06 devstack sudo[106615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330
Sep 09 04:10:06 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:06 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330" returned: 0 in 0.409s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:06 devstack sudo[106620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330
Sep 09 04:10:06 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "cinder-7b516528-bef2-4307-9816-c01f3d7f8162-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-7b516528-bef2-4307-9816-c01f3d7f8162-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "cinder-quobyte-d02b0028-d05b-4214-9cdd-d1dfb4095429" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-quobyte-d02b0028-d05b-4214-9cdd-d1dfb4095429" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "cinder-quobyte-7b516528-bef2-4307-9816-c01f3d7f8162" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-quobyte-7b516528-bef2-4307-9816-c01f3d7f8162" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:06 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Deleting offline snapshot 7b516528-bef2-4307-9816-c01f3d7f8162 of volume d02b0028-d05b-4214-9cdd-d1dfb4095429 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] snapshot_file for this snap is: volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b92223-c400-4964-b201-9948aa60fe04]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:07 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-7fdf3bd5-06fb-4e6e-b695-ab23f1084330" returned: 0 in 0.367s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-7fdf3bd5-06fb-4e6e-b695-ab23f1084330" released by "delete_volume" :: held 0.846s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:07 devstack sudo[106623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162
Sep 09 04:10:07 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Created reservations ['7dcb20a4-47c5-4c30-b0a7-50b3ddd2c6cd', '58cdb2c5-8ab4-4c3f-8e48-d55ffa3dbe09', 'ccccc04e-7812-49f2-a59b-579fcd46c7e6', '34c5e7ee-a874-46e9-b0ca-eb195d087be3'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:07 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:07 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:07 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162" returned: 0 in 0.472s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02b0028-d05b-4214-9cdd-d1dfb4095429(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:10:07 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.263s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:07 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Deleted volume successfully.
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[98710746-e271-418b-8204-4f7ba3028286]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-707c7c2a-b19c-4d10-9b34-18f90a8377d5 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-7fdf3bd5-06fb-4e6e-b695-ab23f1084330-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:07 devstack sudo[106631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429
Sep 09 04:10:07 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (46aa5e40-da0e-4c04-997a-7deb0717e02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4365a20-bd1d-4148-b52f-c9f8a8722995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4365a20-bd1d-4148-b52f-c9f8a8722995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858176988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10777e8d-a936-4b7d-a5d7-652069851763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:08Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378e5ce1-56d3-4804-957c-a74d31a2e846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378e5ce1-56d3-4804-957c-a74d31a2e846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1b00a5-4ef0-4ec9-90f7-d4d4342eef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1b00a5-4ef0-4ec9-90f7-d4d4342eef49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10777e8d-a936-4b7d-a5d7-652069851763', 'volume_name': 'volume-10777e8d-a936-4b7d-a5d7-652069851763', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57107dc-57ec-408a-90cd-23dbdba07ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57107dc-57ec-408a-90cd-23dbdba07ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (249c46e7-3167-4f05-9a98-e00babb2ca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:07 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Volume 10777e8d-a936-4b7d-a5d7-652069851763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10777e8d-a936-4b7d-a5d7-652069851763', 'volume_size': 1}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858176988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10777e8d-a936-4b7d-a5d7-652069851763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:08Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Creating volume 10777e8d-a936-4b7d-a5d7-652069851763 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:07 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:08 devstack sudo[106637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763 1073741824
Sep 09 04:10:08 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:08 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429" returned: 0 in 0.468s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:08 devstack sudo[106639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162
Sep 09 04:10:08 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:08 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162" returned: 0 in 0.390s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:08 devstack sudo[106649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162
Sep 09 04:10:08 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:08 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763 1073741824" returned: 0 in 0.547s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:08 devstack sudo[106651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763
Sep 09 04:10:08 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:08 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429.7b516528-bef2-4307-9816-c01f3d7f8162" returned: 0 in 0.276s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-quobyte-7b516528-bef2-4307-9816-c01f3d7f8162" released by "_delete_snapshot" :: held 1.777s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-quobyte-d02b0028-d05b-4214-9cdd-d1dfb4095429" released by "delete_snapshot" :: held 1.810s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Created reservations ['13ebf49a-5b09-4e73-8589-6c01ba67e71f', '7c9422bc-76dd-424d-ab35-a41f52187dd1', 'e69762a6-d5d1-404d-836e-04ea3523a61a', '76ff7d93-ff6a-4e8a-b4f6-b8111dca1c24'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:08 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763" returned: 0 in 0.336s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (249c46e7-3167-4f05-9a98-e00babb2ca79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10777e8d-a936-4b7d-a5d7-652069851763', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52d1a85-350a-4bd9-a647-4ed098850cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:08 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Volume volume-10777e8d-a936-4b7d-a5d7-652069851763 (10777e8d-a936-4b7d-a5d7-652069851763): created successfully
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52d1a85-350a-4bd9-a647-4ed098850cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (46aa5e40-da0e-4c04-997a-7deb0717e02e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:08 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3517e60e-47e9-45fb-8aa9-5f00fa0d6671 tempest-ProjectMemberTests-1716548698 None] Created volume successfully.
Sep 09 04:10:08 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Delete snapshot completed successfully.
Sep 09 04:10:08 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-098094a3-ba8a-45e1-b626-6fcdf5c68a6a tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-7b516528-bef2-4307-9816-c01f3d7f8162-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "cinder-d02b0028-d05b-4214-9cdd-d1dfb4095429-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-d02b0028-d05b-4214-9cdd-d1dfb4095429-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "cinder-quobyte-d02b0028-d05b-4214-9cdd-d1dfb4095429" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-quobyte-d02b0028-d05b-4214-9cdd-d1dfb4095429" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:09 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[108a55a4-74a6-4efb-aea4-f8a06d8b1b1e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:09 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429
Sep 09 04:10:09 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:09 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429" returned: 0 in 0.382s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:09 devstack sudo[106660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429
Sep 09 04:10:09 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:09 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d02b0028-d05b-4214-9cdd-d1dfb4095429" returned: 0 in 0.263s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:09 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-quobyte-d02b0028-d05b-4214-9cdd-d1dfb4095429" released by "delete_volume" :: held 0.724s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:09 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Created reservations ['abce97b1-1d90-4b08-9fd2-258b2c4451d9', '18648885-4f54-4561-b1aa-da42e9d64f62', 'a94e2d29-30bd-4a48-9e53-b4263c7b7f7d', '31b91fa0-1574-4868-a40b-3cafaefc9837'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:10 devstack sudo[106671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:10 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] Creating offline snapshot 4c94a7d1-f10a-40fc-9a5f-15999528d966 of volume 10777e8d-a936-4b7d-a5d7-652069851763 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fcf9d9-0b34-486b-8e4d-354db96ba6dc]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:10 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.355s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "cinder-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:10 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Deleted volume successfully.
Sep 09 04:10:10 devstack sudo[106701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763
Sep 09 04:10:10 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-8179ddd3-1ce1-41b0-bdb9-efee5ace5bea tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-d02b0028-d05b-4214-9cdd-d1dfb4095429-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "cinder-quobyte-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Flow 'volume_create_manager' (13638e6c-a649-4791-a381-3540e41ac203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda90830-129a-427f-9842-a32f12bb618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-quobyte-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f" acquired by "delete_volume" :: waited 0.073s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda90830-129a-427f-9842-a32f12bb618b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0ac8aa-cf53-4c46-bfc5-076c5013ab13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3fbb0bacdd43a198eeb31d1237efc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:11Z,use_quota=True,user_id='c03628a24fa04d539ce04191024fd708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe1403c-262f-4bf3-bfc0-797aeaea5988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe1403c-262f-4bf3-bfc0-797aeaea5988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0eff02-e3bd-4eab-be33-fbab01fca9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG cinder.image.glance [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Creating Keystone auth plugin from conf {{(pid=87558) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fd9a25-60d8-428e-8e22-43944bd8b9cc]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:10 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763" returned: 0 in 0.580s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:10 devstack sudo[106712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966 1G
Sep 09 04:10:10 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:10 devstack sudo[106711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f
Sep 09 04:10:10 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0eff02-e3bd-4eab-be33-fbab01fca9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a0ac8aa-cf53-4c46-bfc5-076c5013ab13', 'volume_name': 'volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13', 'volume_size': 1, 'image_id': '688fa066-aa8f-44be-b354-ce43498239fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/688fa066-aa8f-44be-b354-ce43498239fb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd3bdcf53d5e07837f37fdd9d1da3b94', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd3fbb0bacdd43a198eeb31d1237efc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd8e37efd7daa2a18e2a8181c4079c57df0a1f0ff01aa7ad9503245f7f650cdf2ccfbf814b339e325ee1f8b73b74dab0535ad6e6991b479c412f5e1918712ec5f', 'id': '688fa066-aa8f-44be-b354-ce43498239fb', 'created_at': datetime.datetime(2026, 9, 9, 2, 10, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 2, 10, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/688fa066-aa8f-44be-b354-ce43498239fb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42b5cfd970>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685555e4-1f82-4778-9bea-0ce6e73db213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:11 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685555e4-1f82-4778-9bea-0ce6e73db213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748ebc18-50b8-4f75-9ecf-95b7cf976455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:11 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Volume 6a0ac8aa-cf53-4c46-bfc5-076c5013ab13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13', 'volume_size': 1, 'image_id': '688fa066-aa8f-44be-b354-ce43498239fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/688fa066-aa8f-44be-b354-ce43498239fb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd3bdcf53d5e07837f37fdd9d1da3b94', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd3fbb0bacdd43a198eeb31d1237efc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd8e37efd7daa2a18e2a8181c4079c57df0a1f0ff01aa7ad9503245f7f650cdf2ccfbf814b339e325ee1f8b73b74dab0535ad6e6991b479c412f5e1918712ec5f', 'id': '688fa066-aa8f-44be-b354-ce43498239fb', 'created_at': datetime.datetime(2026, 9, 9, 2, 10, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 2, 10, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/688fa066-aa8f-44be-b354-ce43498239fb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42b5cfd970>}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Trying to clone 6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 from image 688fa066-aa8f-44be-b354-ce43498239fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/688fa066-aa8f-44be-b354-ce43498239fb', 'metadata': {}}]). {{(pid=87558) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f" returned: 0 in 0.500s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:11 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f
Sep 09 04:10:11 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 04:10:11 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Image download 0.00 MB at 0.00 MB/s
Sep 09 04:10:11 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966 1G" returned: 0 in 0.595s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10777e8d-a936-4b7d-a5d7-652069851763 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b59c21-9c5d-40ab-852a-1680a79ee81c]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:11 devstack sudo[106724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10777e8d-a936-4b7d-a5d7-652069851763 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966
Sep 09 04:10:11 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:11 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD
Sep 09 04:10:11 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:11 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f" returned: 0 in 0.335s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-quobyte-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f" released by "delete_volume" :: held 0.927s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Created reservations ['8a1a450b-d1fe-4146-807f-9062b9b58b7d', 'ed5a54e3-dc38-4d96-bcc1-524af6d70a84', '15a13658-ff01-4a80-bf6f-9491d548c9cf', 'c3c140c7-aa36-4629-a03d-89e05d568909'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:11 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:11 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:11 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10777e8d-a936-4b7d-a5d7-652069851763 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966" returned: 0 in 0.423s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:11 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966 is being set with open permissions: ugo+rw
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:11 devstack sudo[106734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966
Sep 09 04:10:11 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:11 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:12 devstack sudo[106738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD
Sep 09 04:10:12 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:12 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.303s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:12 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Deleted volume successfully.
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-94c67329-ea9c-4363-88fc-fa900e49e3b9 tempest-CinderUnicodeTest-1631581929 None] Lock "cinder-f04b0d4b-8a15-4eb9-a829-e08dcc10fb9f-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:12 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966" returned: 0 in 0.322s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:12 devstack sudo[106742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.info
Sep 09 04:10:12 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:12 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Temporary image 688fa066-aa8f-44be-b354-ce43498239fb is fetched for user c03628a24fa04d539ce04191024fd708. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd76213-9af7-46d2-bf68-8d6ca04d166e]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:12 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.info" returned: 0 in 0.260s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:12 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.info is being set with open permissions: ugo+rw
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:12 devstack sudo[106749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.info
Sep 09 04:10:12 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:12 devstack sudo[106747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD
Sep 09 04:10:12 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:12 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.info" returned: 0 in 0.263s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:12 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.582s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:12 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7dc31c39-76dd-4a2e-a1a6-3a3244ee5ee0 tempest-ProjectMemberTests-1716548698 None] Create snapshot completed successfully
Sep 09 04:10:12 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD
Sep 09 04:10:12 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:13 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0ac8aa-cf53-4c46-bfc5-076c5013ab13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3fbb0bacdd43a198eeb31d1237efc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:11Z,use_quota=True,user_id='c03628a24fa04d539ce04191024fd708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Creating volume 6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:13 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:13 devstack sudo[106760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 1073741824
Sep 09 04:10:13 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-4c94a7d1-f10a-40fc-9a5f-15999528d966-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Lock "cinder-4c94a7d1-f10a-40fc-9a5f-15999528d966-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-10777e8d-a936-4b7d-a5d7-652069851763" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-10777e8d-a936-4b7d-a5d7-652069851763" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-4c94a7d1-f10a-40fc-9a5f-15999528d966" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-4c94a7d1-f10a-40fc-9a5f-15999528d966" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Deleting offline snapshot 4c94a7d1-f10a-40fc-9a5f-15999528d966 of volume 10777e8d-a936-4b7d-a5d7-652069851763 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] snapshot_file for this snap is: volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75c3713-a21b-48e0-977c-384e1b0ef954]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:13 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966
Sep 09 04:10:13 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:13 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 1073741824" returned: 0 in 0.567s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:13 devstack sudo[106768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13
Sep 09 04:10:13 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:13 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966" returned: 0 in 0.502s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10777e8d-a936-4b7d-a5d7-652069851763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea453fa-c27d-4756-b626-f97c25d27606]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:14 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13" returned: 0 in 0.325s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:14 devstack sudo[106773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763
Sep 09 04:10:14 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:14 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Attempting download of 688fa066-aa8f-44be-b354-ce43498239fb ((None, [{'url': 'file:///opt/stack/data/glance/images/688fa066-aa8f-44be-b354-ce43498239fb', 'metadata': {}}])) to volume 6a0ac8aa-cf53-4c46-bfc5-076c5013ab13. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 04:10:14 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d18b58c-92e9-4301-9512-cf96ff2f59cf]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_688fa066-aa8f-44be-b354-ce43498239fb_inbzl7v8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:14 devstack sudo[106776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_688fa066-aa8f-44be-b354-ce43498239fb_inbzl7v8
Sep 09 04:10:14 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:14 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763" returned: 0 in 0.459s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:14 devstack sudo[106782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966
Sep 09 04:10:14 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:14 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_688fa066-aa8f-44be-b354-ce43498239fb_inbzl7v8" returned: 0 in 0.442s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_688fa066-aa8f-44be-b354-ce43498239fb_inbzl7v8 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:14 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_688fa066-aa8f-44be-b354-ce43498239fb_inbzl7v8
Sep 09 04:10:14 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:14 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966" returned: 0 in 0.419s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:14 devstack sudo[106791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966
Sep 09 04:10:14 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:15 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_688fa066-aa8f-44be-b354-ce43498239fb_inbzl7v8" returned: 1 in 0.381s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_688fa066-aa8f-44be-b354-ce43498239fb_inbzl7v8' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dd1674-16c1-4bc1-b050-a428a0077632]: (4, 'raw') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:15 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763.4c94a7d1-f10a-40fc-9a5f-15999528d966" returned: 0 in 0.333s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:15 devstack sudo[106795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD
Sep 09 04:10:15 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-4c94a7d1-f10a-40fc-9a5f-15999528d966" released by "_delete_snapshot" :: held 1.878s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-10777e8d-a936-4b7d-a5d7-652069851763" released by "delete_snapshot" :: held 1.908s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Created reservations ['831b0b10-41f9-4c5b-bb34-6051de40ac05', '10efba40-443f-4798-b79d-0bbf95d44e12', '69abe18a-9357-433b-a717-04866df385a6', 'af59b14d-05ef-41e2-9585-f1374d4fe618'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:15 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Delete snapshot completed successfully.
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-27a6e261-59ed-457a-84b0-5ecd7edd45cd tempest-ProjectMemberTests-1716548698 None] Lock "cinder-4c94a7d1-f10a-40fc-9a5f-15999528d966-delete_snapshot" released by "delete_snapshot" :: held 2.091s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:15 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:15 devstack sudo[106801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD
Sep 09 04:10:15 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-10777e8d-a936-4b7d-a5d7-652069851763-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:15 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-10777e8d-a936-4b7d-a5d7-652069851763-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD" returned: 1 in 0.474s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] 688fa066-aa8f-44be-b354-ce43498239fb was raw, converting to qcow2 {{(pid=87558) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 04:10:15 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:16 devstack sudo[106806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13
Sep 09 04:10:16 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-10777e8d-a936-4b7d-a5d7-652069851763" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-10777e8d-a936-4b7d-a5d7-652069851763" acquired by "delete_volume" :: waited 0.022s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[93367cea-3b8b-4632-9793-d10096340e3a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:16 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763
Sep 09 04:10:16 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:16 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13" returned: 0 in 0.555s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_688fa066-aa8f-44be-b354-ce43498239fb_v2ybv1rrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 04:10:16 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Converted 0.00 MB image at 0.00 MB/s
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:16 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763" returned: 0 in 0.455s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:16 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 1G
Sep 09 04:10:16 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:16 devstack sudo[106820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763
Sep 09 04:10:16 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:16 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-10777e8d-a936-4b7d-a5d7-652069851763" returned: 0 in 0.365s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-10777e8d-a936-4b7d-a5d7-652069851763" released by "delete_volume" :: held 0.901s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:16 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=299,cinder:SELECT=226,cinder:INSERT=81,cinder:DELETE=26 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 1G" returned: 0 in 0.428s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Downloaded image 688fa066-aa8f-44be-b354-ce43498239fb ((None, [{'url': 'file:///opt/stack/data/glance/images/688fa066-aa8f-44be-b354-ce43498239fb', 'metadata': {}}])) to volume 6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 successfully. {{(pid=87558) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Temporary image 688fa066-aa8f-44be-b354-ce43498239fb for user c03628a24fa04d539ce04191024fd708 is deleted. {{(pid=87558) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 04:10:16 devstack cinder-volume[87558]: DEBUG cinder.volume.volume_utils [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Marking volume 6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 as bootable. {{(pid=87558) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Copying metadata from image 688fa066-aa8f-44be-b354-ce43498239fb to 6a0ac8aa-cf53-4c46-bfc5-076c5013ab13. {{(pid=87558) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Creating volume glance metadata for volume 6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 backed by image 688fa066-aa8f-44be-b354-ce43498239fb with: {'image_id': '688fa066-aa8f-44be-b354-ce43498239fb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'dd3bdcf53d5e07837f37fdd9d1da3b94', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87558) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=222,cinder:UPDATE=293,cinder:INSERT=78,cinder:DELETE=26 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Created reservations ['458143a1-93d1-47ca-9e19-821917f35b97', 'ffa87755-e6fc-46bf-91c2-2b0e22c53644', '51ccc247-d742-4160-b0b6-c8591e0de6b5', '1d1f5f15-b7f2-4510-a8b4-a4d88201f1e5'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748ebc18-50b8-4f75-9ecf-95b7cf976455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13', 'volume_size': 1, 'image_id': '688fa066-aa8f-44be-b354-ce43498239fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/688fa066-aa8f-44be-b354-ce43498239fb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd3bdcf53d5e07837f37fdd9d1da3b94', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd3fbb0bacdd43a198eeb31d1237efc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd8e37efd7daa2a18e2a8181c4079c57df0a1f0ff01aa7ad9503245f7f650cdf2ccfbf814b339e325ee1f8b73b74dab0535ad6e6991b479c412f5e1918712ec5f', 'id': '688fa066-aa8f-44be-b354-ce43498239fb', 'created_at': datetime.datetime(2026, 9, 9, 2, 10, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 2, 10, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/688fa066-aa8f-44be-b354-ce43498239fb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d42b5cfd970>}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8c3680-9ba2-45a9-a123-1f765ac4e789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:17 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Volume volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 (6a0ac8aa-cf53-4c46-bfc5-076c5013ab13): created successfully
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8c3680-9ba2-45a9-a123-1f765ac4e789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Flow 'volume_create_manager' (13638e6c-a649-4791-a381-3540e41ac203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:17 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ec947674-4608-47f8-817f-bd5e4397f498 tempest-VolumeImageDependencyTests-625077349 None] Created volume successfully.
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:17 devstack sudo[106826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:17 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:17 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.271s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:17 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Deleted volume successfully.
Sep 09 04:10:17 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1548bcfd-6e39-44db-9dbb-f286c673c940 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-10777e8d-a936-4b7d-a5d7-652069851763-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Acquiring lock "cinder-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Lock "cinder-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Acquiring lock "cinder-quobyte-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Lock "cinder-quobyte-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13" acquired by "delete_volume" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e897e41e-c91f-4e0d-ba7e-f88aec5f320c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:18 devstack sudo[106829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13
Sep 09 04:10:18 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:18 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13" returned: 0 in 0.418s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:18 devstack sudo[106834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13
Sep 09 04:10:18 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (4e5d3652-6e05-438c-b4f9-5d28cb94e585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18a6439-b35f-477e-aecd-7640874f408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18a6439-b35f-477e-aecd-7640874f408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-371778889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868ca24f-dca5-4d1f-8025-09d4a0db6104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:19Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b41ad55-2b66-449f-a8a3-e6cfa799c4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b41ad55-2b66-449f-a8a3-e6cfa799c4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c09e7d-07e9-4eed-b909-1d568aac29dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c09e7d-07e9-4eed-b909-1d568aac29dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '868ca24f-dca5-4d1f-8025-09d4a0db6104', 'volume_name': 'volume-868ca24f-dca5-4d1f-8025-09d4a0db6104', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4343eb03-74b7-43f7-b52d-653f958c8cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4343eb03-74b7-43f7-b52d-653f958c8cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f050a3-8c07-40f0-88f6-7f4f3648ee60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:18 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Volume 868ca24f-dca5-4d1f-8025-09d4a0db6104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-868ca24f-dca5-4d1f-8025-09d4a0db6104', 'volume_size': 1}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-371778889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868ca24f-dca5-4d1f-8025-09d4a0db6104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:19Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Creating volume 868ca24f-dca5-4d1f-8025-09d4a0db6104 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:18 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:19 devstack sudo[106836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104 1073741824
Sep 09 04:10:19 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:19 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13" returned: 0 in 0.330s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Lock "cinder-quobyte-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13" released by "delete_volume" :: held 0.801s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Created reservations ['b389a6a1-f151-4ec2-878a-3ff24b23d51a', '54d4cc7f-f82c-4528-b5a4-d0ceb4bbc9f9', 'a46c0b92-1d36-4be3-8a3a-805bc4a50fbb', '0453d13a-0f41-4967-bc11-706f4b7a112d'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:19 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:19 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:19 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.400s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:19 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104 1073741824" returned: 0 in 0.734s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:19 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Deleted volume successfully.
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-7e993cd4-785b-4ffc-9013-b7754fd90578 tempest-VolumeImageDependencyTests-625077349 None] Lock "cinder-6a0ac8aa-cf53-4c46-bfc5-076c5013ab13-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:19 devstack sudo[106846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104
Sep 09 04:10:19 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:20 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104" returned: 0 in 0.315s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f050a3-8c07-40f0-88f6-7f4f3648ee60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868ca24f-dca5-4d1f-8025-09d4a0db6104', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4367e9e7-9d0e-4542-a220-4f999a4d7b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:20 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Volume volume-868ca24f-dca5-4d1f-8025-09d4a0db6104 (868ca24f-dca5-4d1f-8025-09d4a0db6104): created successfully
Sep 09 04:10:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4367e9e7-9d0e-4542-a220-4f999a4d7b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (4e5d3652-6e05-438c-b4f9-5d28cb94e585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:20 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7eb0e79f-098d-4c37-9e4a-3a670744612b tempest-ProjectMemberTests-1716548698 None] Created volume successfully.
Sep 09 04:10:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] Creating offline snapshot eac555e9-1dc8-4bb8-9d3d-5d522f3831d9 of volume 868ca24f-dca5-4d1f-8025-09d4a0db6104 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:10:21 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb260b6-a620-4fd1-bc99-02d0ddbe42c7]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:21 devstack sudo[106849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104
Sep 09 04:10:21 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:21 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104" returned: 0 in 0.436s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:21 devstack sudo[106854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9 1G
Sep 09 04:10:21 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:22 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9 1G" returned: 0 in 0.618s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868ca24f-dca5-4d1f-8025-09d4a0db6104 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:22 devstack sudo[106859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868ca24f-dca5-4d1f-8025-09d4a0db6104 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9
Sep 09 04:10:22 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:22 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868ca24f-dca5-4d1f-8025-09d4a0db6104 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9" returned: 0 in 0.405s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:22 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9 is being set with open permissions: ugo+rw
Sep 09 04:10:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:22 devstack sudo[106864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9
Sep 09 04:10:22 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:22 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9" returned: 0 in 0.339s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:23 devstack sudo[106867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.info
Sep 09 04:10:23 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:23 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.info" returned: 0 in 0.445s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:23 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.info is being set with open permissions: ugo+rw
Sep 09 04:10:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:23 devstack sudo[106870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.info
Sep 09 04:10:23 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:23 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.info" returned: 0 in 0.300s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.681s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:23 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b7acd165-a555-44ad-ba2a-64ef26702321 tempest-ProjectMemberTests-1716548698 None] Create snapshot completed successfully
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-eac555e9-1dc8-4bb8-9d3d-5d522f3831d9-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Lock "cinder-eac555e9-1dc8-4bb8-9d3d-5d522f3831d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-868ca24f-dca5-4d1f-8025-09d4a0db6104" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-868ca24f-dca5-4d1f-8025-09d4a0db6104" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-eac555e9-1dc8-4bb8-9d3d-5d522f3831d9" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-eac555e9-1dc8-4bb8-9d3d-5d522f3831d9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Deleting offline snapshot eac555e9-1dc8-4bb8-9d3d-5d522f3831d9 of volume 868ca24f-dca5-4d1f-8025-09d4a0db6104 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] snapshot_file for this snap is: volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4f4b81-7233-4973-a749-78919ccae1e9]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:24 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9
Sep 09 04:10:24 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0f1a70bf-ade5-4c55-8089-4d70ecb47402 tempest-ProjectAdminTests-827415242 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.423496246338, 'free_capacity_gb': 1773.423496246338, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87558) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 09 04:10:24 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9" returned: 0 in 0.432s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868ca24f-dca5-4d1f-8025-09d4a0db6104(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d6545d-e625-410c-8595-d407c3510db0]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:25 devstack sudo[106884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104
Sep 09 04:10:25 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:25 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104" returned: 0 in 0.475s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:25 devstack sudo[106890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9
Sep 09 04:10:25 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:25 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9" returned: 0 in 0.446s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:25 devstack sudo[106895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9
Sep 09 04:10:25 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:26 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104.eac555e9-1dc8-4bb8-9d3d-5d522f3831d9" returned: 0 in 0.402s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-eac555e9-1dc8-4bb8-9d3d-5d522f3831d9" released by "_delete_snapshot" :: held 1.899s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-868ca24f-dca5-4d1f-8025-09d4a0db6104" released by "delete_snapshot" :: held 1.933s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Created reservations ['40015df1-b954-4bc3-a972-6339926ee501', 'ad6e659e-21eb-4788-bf80-6599cab4d13c', 'daf4ecbc-a356-4af6-83e1-9fe752f26274', '106e7a2d-f90a-4aac-8e41-8d3a2bc9ec4c'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:26 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Delete snapshot completed successfully.
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e26ccb62-6495-4019-a500-73deff7d12ca tempest-ProjectMemberTests-1716548698 None] Lock "cinder-eac555e9-1dc8-4bb8-9d3d-5d522f3831d9-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-868ca24f-dca5-4d1f-8025-09d4a0db6104-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Lock "cinder-868ca24f-dca5-4d1f-8025-09d4a0db6104-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-868ca24f-dca5-4d1f-8025-09d4a0db6104" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-868ca24f-dca5-4d1f-8025-09d4a0db6104" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[017ba718-429d-4f24-a981-0af8c346d750]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:26 devstack sudo[106898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104
Sep 09 04:10:26 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:27 devstack sudo[106900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:27 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:27 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104" returned: 0 in 0.498s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:27 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104
Sep 09 04:10:27 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:27 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.383s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 04:10:27 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-868ca24f-dca5-4d1f-8025-09d4a0db6104" returned: 0 in 0.333s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-868ca24f-dca5-4d1f-8025-09d4a0db6104" released by "delete_volume" :: held 0.917s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Created reservations ['2ed2c3e9-de7a-431c-92a4-e23a00e8a91c', '57892c34-1a45-4ff9-8f9f-c8c1b8a49b25', '7862d469-9d78-47ed-977f-7603350b17f6', '94a9c74d-85d5-4a90-a015-6aec73b76c98'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:27 devstack sudo[106909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:27 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:28 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.454s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:28 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Deleted volume successfully.
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b6d2938c-a301-48fb-b89d-380f9fa61f7d tempest-ProjectMemberTests-1716548698 None] Lock "cinder-868ca24f-dca5-4d1f-8025-09d4a0db6104-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Flow 'volume_create_manager' (f224ea8a-be45-43a8-a33f-6e9e52bb2059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b62532c-b365-4453-bd8f-f407575394f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b62532c-b365-4453-bd8f-f407575394f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352849895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21cd8002-58c8-49aa-bcba-af994a6b3193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66cefb47277447aaa251b8b003f42d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:28Z,use_quota=True,user_id='067696c3d52f4b6fbc00d79dea7c31e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec23487b-30bc-4635-8532-8eda5a27ec98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec23487b-30bc-4635-8532-8eda5a27ec98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08924478-d254-43dd-9056-c1a6de7b33e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08924478-d254-43dd-9056-c1a6de7b33e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21cd8002-58c8-49aa-bcba-af994a6b3193', 'volume_name': 'volume-21cd8002-58c8-49aa-bcba-af994a6b3193', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715bafc9-41c9-4ff2-825f-be4f78400220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715bafc9-41c9-4ff2-825f-be4f78400220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df98244-fe4c-4af8-943a-e8cb5addc9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:28 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Volume 21cd8002-58c8-49aa-bcba-af994a6b3193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21cd8002-58c8-49aa-bcba-af994a6b3193', 'volume_size': 1}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352849895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21cd8002-58c8-49aa-bcba-af994a6b3193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66cefb47277447aaa251b8b003f42d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:28Z,use_quota=True,user_id='067696c3d52f4b6fbc00d79dea7c31e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Creating volume 21cd8002-58c8-49aa-bcba-af994a6b3193 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:28 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-21cd8002-58c8-49aa-bcba-af994a6b3193 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:28 devstack sudo[106912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-21cd8002-58c8-49aa-bcba-af994a6b3193 1073741824
Sep 09 04:10:28 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (0906a57f-ba2d-4f9a-96c0-9b08a175c399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9688c12-089c-43b0-b1cd-17d4a5e7f2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9688c12-089c-43b0-b1cd-17d4a5e7f2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-965499118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb39807-9877-49cc-a942-c594a7ada9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:28Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa80a17-ae21-4014-a015-9c7cdfc369b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa80a17-ae21-4014-a015-9c7cdfc369b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0396aa-db4c-47b6-951a-ab12bce85e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0396aa-db4c-47b6-951a-ab12bce85e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eb39807-9877-49cc-a942-c594a7ada9e4', 'volume_name': 'volume-0eb39807-9877-49cc-a942-c594a7ada9e4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c286c3b7-148b-4c00-ae50-a84c75b53f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c286c3b7-148b-4c00-ae50-a84c75b53f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad696e23-cfe8-4a36-b20d-2f695464e75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:28 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Volume 0eb39807-9877-49cc-a942-c594a7ada9e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eb39807-9877-49cc-a942-c594a7ada9e4', 'volume_size': 1}
Sep 09 04:10:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:29 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-21cd8002-58c8-49aa-bcba-af994a6b3193 1073741824" returned: 0 in 0.477s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-21cd8002-58c8-49aa-bcba-af994a6b3193 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:29 devstack sudo[106918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-21cd8002-58c8-49aa-bcba-af994a6b3193
Sep 09 04:10:29 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:29 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-21cd8002-58c8-49aa-bcba-af994a6b3193" returned: 0 in 0.273s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.600s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-965499118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb39807-9877-49cc-a942-c594a7ada9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:28Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Creating volume 0eb39807-9877-49cc-a942-c594a7ada9e4 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:29 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df98244-fe4c-4af8-943a-e8cb5addc9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21cd8002-58c8-49aa-bcba-af994a6b3193', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:29 devstack sudo[106921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4 1073741824
Sep 09 04:10:29 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55596506-3230-4437-9eb0-6bb825a4f5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:29 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Volume volume-21cd8002-58c8-49aa-bcba-af994a6b3193 (21cd8002-58c8-49aa-bcba-af994a6b3193): created successfully
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55596506-3230-4437-9eb0-6bb825a4f5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Flow 'volume_create_manager' (f224ea8a-be45-43a8-a33f-6e9e52bb2059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:29 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a3c16dc6-2cb9-442e-b98f-4bcf37823dfc tempest-ProjectReaderTests-1105638997 None] Created volume successfully.
Sep 09 04:10:29 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4 1073741824" returned: 0 in 0.539s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:29 devstack sudo[106927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4
Sep 09 04:10:29 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:30 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4" returned: 0 in 0.264s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad696e23-cfe8-4a36-b20d-2f695464e75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eb39807-9877-49cc-a942-c594a7ada9e4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee211c0e-d6fa-4345-a699-6b65127d9a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:30 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Volume volume-0eb39807-9877-49cc-a942-c594a7ada9e4 (0eb39807-9877-49cc-a942-c594a7ada9e4): created successfully
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee211c0e-d6fa-4345-a699-6b65127d9a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (0906a57f-ba2d-4f9a-96c0-9b08a175c399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e333df8f-7eb7-4baa-9c53-88e0d80d6f33 tempest-ProjectMemberTests-1716548698 None] Created volume successfully.
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Acquiring lock "cinder-21cd8002-58c8-49aa-bcba-af994a6b3193-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Lock "cinder-21cd8002-58c8-49aa-bcba-af994a6b3193-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Acquiring lock "cinder-quobyte-21cd8002-58c8-49aa-bcba-af994a6b3193" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Lock "cinder-quobyte-21cd8002-58c8-49aa-bcba-af994a6b3193" acquired by "delete_volume" :: waited 0.053s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[169778cc-58ef-479b-a873-d9c852dd2fd9]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-21cd8002-58c8-49aa-bcba-af994a6b3193 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] Creating offline snapshot 5c4aaf68-13b5-4024-8b18-c068bbcdc71a of volume 0eb39807-9877-49cc-a942-c594a7ada9e4 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dcab6d-3a24-4754-b880-4bf43290d8f0]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:30 devstack sudo[106930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-21cd8002-58c8-49aa-bcba-af994a6b3193
Sep 09 04:10:30 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:30 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4
Sep 09 04:10:30 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:31 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4" returned: 0 in 0.498s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:31 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-21cd8002-58c8-49aa-bcba-af994a6b3193" returned: 0 in 0.553s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-21cd8002-58c8-49aa-bcba-af994a6b3193 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:31 devstack sudo[106940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a 1G
Sep 09 04:10:31 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:31 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-21cd8002-58c8-49aa-bcba-af994a6b3193
Sep 09 04:10:31 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:31 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-21cd8002-58c8-49aa-bcba-af994a6b3193" returned: 0 in 0.376s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Lock "cinder-quobyte-21cd8002-58c8-49aa-bcba-af994a6b3193" released by "delete_volume" :: held 0.989s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Created reservations ['fa7f9222-f602-4533-92c7-c1319b357317', 'a02611d8-20b6-458c-8bca-ab7fa70f7764', 'e83705b2-7b08-4551-b690-c9ba22c614de', '1bc80ca4-016a-4273-a338-da2b09357abf'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:31 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a 1G" returned: 0 in 0.531s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eb39807-9877-49cc-a942-c594a7ada9e4 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:31 devstack sudo[106949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eb39807-9877-49cc-a942-c594a7ada9e4 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a
Sep 09 04:10:31 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:31 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:31 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:32 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eb39807-9877-49cc-a942-c594a7ada9e4 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a" returned: 0 in 0.363s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:32 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a is being set with open permissions: ugo+rw
Sep 09 04:10:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:32 devstack sudo[106958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a
Sep 09 04:10:32 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:32 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.319s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:32 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:32 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Deleted volume successfully.
Sep 09 04:10:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-4e3a4d98-4dfc-4e3e-8aee-1cc320507d94 tempest-ProjectReaderTests-1105638997 None] Lock "cinder-21cd8002-58c8-49aa-bcba-af994a6b3193-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:32 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a" returned: 0 in 0.256s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:32 devstack sudo[106961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.info
Sep 09 04:10:32 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:32 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.info" returned: 0 in 0.257s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:32 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.info is being set with open permissions: ugo+rw
Sep 09 04:10:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:32 devstack sudo[106964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.info
Sep 09 04:10:32 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:33 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.info" returned: 0 in 0.409s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.430s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:33 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-baf413f1-a417-48d2-8d21-7a53f4b3ffd9 tempest-ProjectMemberTests-1716548698 None] Create snapshot completed successfully
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Flow 'volume_create_manager' (52c6cb1c-9bea-492d-a77f-b214db987164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc8e2bf-34aa-40d2-a55a-b7edf11a580b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc8e2bf-34aa-40d2-a55a-b7edf11a580b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2119829949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a769eebd-434b-47f1-81ac-31134af2d48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66cefb47277447aaa251b8b003f42d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:33Z,use_quota=True,user_id='067696c3d52f4b6fbc00d79dea7c31e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166c4823-41c6-4691-98aa-bad754463f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166c4823-41c6-4691-98aa-bad754463f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3d4ea0-23ba-4491-a0c8-59d8f1adb5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3d4ea0-23ba-4491-a0c8-59d8f1adb5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a769eebd-434b-47f1-81ac-31134af2d48c', 'volume_name': 'volume-a769eebd-434b-47f1-81ac-31134af2d48c', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6dcf52-4841-4a12-9175-d6e9094e6c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6dcf52-4841-4a12-9175-d6e9094e6c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47c998c-5f5b-4e97-bf51-7ff29d7a1726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:33 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Volume a769eebd-434b-47f1-81ac-31134af2d48c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a769eebd-434b-47f1-81ac-31134af2d48c', 'volume_size': 1}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2119829949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a769eebd-434b-47f1-81ac-31134af2d48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66cefb47277447aaa251b8b003f42d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:33Z,use_quota=True,user_id='067696c3d52f4b6fbc00d79dea7c31e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Creating volume a769eebd-434b-47f1-81ac-31134af2d48c {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:33 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a769eebd-434b-47f1-81ac-31134af2d48c 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:33 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a769eebd-434b-47f1-81ac-31134af2d48c 1073741824
Sep 09 04:10:33 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-5c4aaf68-13b5-4024-8b18-c068bbcdc71a-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Lock "cinder-5c4aaf68-13b5-4024-8b18-c068bbcdc71a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:33 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-0eb39807-9877-49cc-a942-c594a7ada9e4" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-0eb39807-9877-49cc-a942-c594a7ada9e4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-5c4aaf68-13b5-4024-8b18-c068bbcdc71a" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-5c4aaf68-13b5-4024-8b18-c068bbcdc71a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Deleting offline snapshot 5c4aaf68-13b5-4024-8b18-c068bbcdc71a of volume 0eb39807-9877-49cc-a942-c594a7ada9e4 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] snapshot_file for this snap is: volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcdaf9f-363e-4dab-af20-a9b3a3bb756d]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:34 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a769eebd-434b-47f1-81ac-31134af2d48c 1073741824" returned: 0 in 0.526s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a769eebd-434b-47f1-81ac-31134af2d48c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:34 devstack sudo[106974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a769eebd-434b-47f1-81ac-31134af2d48c
Sep 09 04:10:34 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:34 devstack sudo[106973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a
Sep 09 04:10:34 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:34 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a769eebd-434b-47f1-81ac-31134af2d48c" returned: 0 in 0.285s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47c998c-5f5b-4e97-bf51-7ff29d7a1726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a769eebd-434b-47f1-81ac-31134af2d48c', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade424a7-fa82-4c53-b4a7-9c821578af22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:34 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Volume volume-a769eebd-434b-47f1-81ac-31134af2d48c (a769eebd-434b-47f1-81ac-31134af2d48c): created successfully
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade424a7-fa82-4c53-b4a7-9c821578af22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Flow 'volume_create_manager' (52c6cb1c-9bea-492d-a77f-b214db987164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:34 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a" returned: 0 in 0.418s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eb39807-9877-49cc-a942-c594a7ada9e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:10:34 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-4e6031d0-b4ad-4ce9-bdd0-183162f5ea1f tempest-ProjectReaderTests-1105638997 None] Created volume successfully.
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3784248-ebd6-4ed7-ac08-2176229532ac]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:34 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4
Sep 09 04:10:34 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Flow 'volume_create_manager' (9c9e2f50-2d94-4cd0-a060-f3c9a33c3734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b01c0f-e35f-41e9-8fca-58ecb4608226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b01c0f-e35f-41e9-8fca-58ecb4608226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1711308367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27aa8476-57db-4310-903b-e039dd4d04a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946fba4b50994061a81dd9a2f4a44a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:35Z,use_quota=True,user_id='996521c8e22c4927bfbbb277519f6506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b9bbec-a590-4544-a4e7-78db71e03742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b9bbec-a590-4544-a4e7-78db71e03742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998adb01-5241-46e3-9ab8-27cc8d5d8888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998adb01-5241-46e3-9ab8-27cc8d5d8888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27aa8476-57db-4310-903b-e039dd4d04a1', 'volume_name': 'volume-27aa8476-57db-4310-903b-e039dd4d04a1', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3efd609-0fd5-4e11-9a7c-5cfee275d50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3efd609-0fd5-4e11-9a7c-5cfee275d50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2f67c5-2d6a-4788-ab2e-2da0e1c1e8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:34 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Volume 27aa8476-57db-4310-903b-e039dd4d04a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27aa8476-57db-4310-903b-e039dd4d04a1', 'volume_size': 1}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1711308367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27aa8476-57db-4310-903b-e039dd4d04a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946fba4b50994061a81dd9a2f4a44a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:35Z,use_quota=True,user_id='996521c8e22c4927bfbbb277519f6506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Creating volume 27aa8476-57db-4310-903b-e039dd4d04a1 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:34 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-27aa8476-57db-4310-903b-e039dd4d04a1 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:34 devstack sudo[106985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-27aa8476-57db-4310-903b-e039dd4d04a1 1073741824
Sep 09 04:10:34 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:34 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4" returned: 0 in 0.422s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:34 devstack sudo[106990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a
Sep 09 04:10:34 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:35 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a" returned: 0 in 0.382s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:35 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-27aa8476-57db-4310-903b-e039dd4d04a1 1073741824" returned: 0 in 0.496s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:35 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a
Sep 09 04:10:35 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-27aa8476-57db-4310-903b-e039dd4d04a1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:35 devstack sudo[107001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-27aa8476-57db-4310-903b-e039dd4d04a1
Sep 09 04:10:35 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Acquiring lock "cinder-a769eebd-434b-47f1-81ac-31134af2d48c-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Lock "cinder-a769eebd-434b-47f1-81ac-31134af2d48c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:35 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4.5c4aaf68-13b5-4024-8b18-c068bbcdc71a" returned: 0 in 0.340s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-5c4aaf68-13b5-4024-8b18-c068bbcdc71a" released by "_delete_snapshot" :: held 1.692s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-0eb39807-9877-49cc-a942-c594a7ada9e4" released by "delete_snapshot" :: held 1.726s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:35 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-27aa8476-57db-4310-903b-e039dd4d04a1" returned: 0 in 0.356s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Acquiring lock "cinder-quobyte-a769eebd-434b-47f1-81ac-31134af2d48c" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2f67c5-2d6a-4788-ab2e-2da0e1c1e8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27aa8476-57db-4310-903b-e039dd4d04a1', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e529a59-4887-444e-9d9a-00d8c2089ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Lock "cinder-quobyte-a769eebd-434b-47f1-81ac-31134af2d48c" acquired by "delete_volume" :: waited 0.037s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:35 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Volume volume-27aa8476-57db-4310-903b-e039dd4d04a1 (27aa8476-57db-4310-903b-e039dd4d04a1): created successfully
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e529a59-4887-444e-9d9a-00d8c2089ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Flow 'volume_create_manager' (9c9e2f50-2d94-4cd0-a060-f3c9a33c3734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[88666e75-92f4-4521-92af-d70b5a8fe4d8]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a769eebd-434b-47f1-81ac-31134af2d48c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:35 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-dbf2ff34-857c-4ca1-a2eb-fbeaf3d6ec13 tempest-ProjectReaderTests-613364189 None] Created volume successfully.
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Created reservations ['b1774e26-7ff4-4da3-a461-3b94be775c34', 'edb099f8-e091-4a9a-92d0-a622943714f7', 'fb4f185e-1c54-4436-b4f6-0a8a9193c010', '6017efc0-16aa-4088-9802-ca4c23cbe62d'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:35 devstack sudo[107006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a769eebd-434b-47f1-81ac-31134af2d48c
Sep 09 04:10:35 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:35 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Delete snapshot completed successfully.
Sep 09 04:10:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-daf949e4-2ef0-45f9-b898-7fce6bf75d4b tempest-ProjectMemberTests-1716548698 None] Lock "cinder-5c4aaf68-13b5-4024-8b18-c068bbcdc71a-delete_snapshot" released by "delete_snapshot" :: held 1.989s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-0eb39807-9877-49cc-a942-c594a7ada9e4-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Lock "cinder-0eb39807-9877-49cc-a942-c594a7ada9e4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-0eb39807-9877-49cc-a942-c594a7ada9e4" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-0eb39807-9877-49cc-a942-c594a7ada9e4" acquired by "delete_volume" :: waited 0.029s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:36 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a769eebd-434b-47f1-81ac-31134af2d48c" returned: 0 in 0.462s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a769eebd-434b-47f1-81ac-31134af2d48c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4eb233-d0b4-457f-b7ab-efe4b2aab294]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:36 devstack sudo[107011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a769eebd-434b-47f1-81ac-31134af2d48c
Sep 09 04:10:36 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:36 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4
Sep 09 04:10:36 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:36 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a769eebd-434b-47f1-81ac-31134af2d48c" returned: 0 in 0.275s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Lock "cinder-quobyte-a769eebd-434b-47f1-81ac-31134af2d48c" released by "delete_volume" :: held 0.800s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Created reservations ['5ad42243-2332-4e28-8157-a1382eff86ce', '211d84ef-386e-423a-9c47-798bac724f07', '93b57a61-86db-4118-8bf5-0e42d04e1cd4', '52d5cf4e-53ff-45b2-a390-ca881a405b97'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:36 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4" returned: 0 in 0.445s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:36 devstack sudo[107019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4
Sep 09 04:10:36 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:36 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:36 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:37 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-0eb39807-9877-49cc-a942-c594a7ada9e4" returned: 0 in 0.309s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-0eb39807-9877-49cc-a942-c594a7ada9e4" released by "delete_volume" :: held 0.850s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:37 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.313s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:37 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Deleted volume successfully.
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bbbfbb36-12a9-4e67-ae33-a27e6a1d3b10 tempest-ProjectReaderTests-1105638997 None] Lock "cinder-a769eebd-434b-47f1-81ac-31134af2d48c-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Created reservations ['6726694b-8403-4728-a59b-806c120e491e', 'a4ae6c9b-53c7-4361-801a-d92950c2c61a', '787d1684-7aea-4b2a-b269-f079724ed3fe', '17a3fb3b-5c5d-45e8-9402-4505376bc5e2'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:37 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:37 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Acquiring lock "cinder-27aa8476-57db-4310-903b-e039dd4d04a1-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Lock "cinder-27aa8476-57db-4310-903b-e039dd4d04a1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Acquiring lock "cinder-quobyte-27aa8476-57db-4310-903b-e039dd4d04a1" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Lock "cinder-quobyte-27aa8476-57db-4310-903b-e039dd4d04a1" acquired by "delete_volume" :: waited 0.025s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fbe50c-ad5f-4435-8855-35d5b1a0c2bf]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-27aa8476-57db-4310-903b-e039dd4d04a1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:37 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.312s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:37 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Deleted volume successfully.
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-1520ba37-789f-4dbd-96f2-84d39b141dbd tempest-ProjectMemberTests-1716548698 None] Lock "cinder-0eb39807-9877-49cc-a942-c594a7ada9e4-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:37 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-27aa8476-57db-4310-903b-e039dd4d04a1
Sep 09 04:10:37 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (ff93563d-247b-42fc-ab49-dfa84d853e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c3c689-edfc-459f-877d-0c092f94187f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c3c689-edfc-459f-877d-0c092f94187f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093498206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04de66af-f05c-4ec9-b68a-d70c5c5093ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:38Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:37 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef0ab77-226c-42b2-ba72-5d4f3043e8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef0ab77-226c-42b2-ba72-5d4f3043e8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd704e9-10a8-4434-9599-75b59c908fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd704e9-10a8-4434-9599-75b59c908fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04de66af-f05c-4ec9-b68a-d70c5c5093ac', 'volume_name': 'volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797b0a4f-0567-4849-8015-b9798081daff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797b0a4f-0567-4849-8015-b9798081daff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc139df-2b0b-43e4-8894-3074ffb79b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:38 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Volume 04de66af-f05c-4ec9-b68a-d70c5c5093ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac', 'volume_size': 1}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093498206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04de66af-f05c-4ec9-b68a-d70c5c5093ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:38Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Creating volume 04de66af-f05c-4ec9-b68a-d70c5c5093ac {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:38 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:38 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-27aa8476-57db-4310-903b-e039dd4d04a1" returned: 0 in 0.447s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-27aa8476-57db-4310-903b-e039dd4d04a1 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:38 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac 1073741824
Sep 09 04:10:38 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:38 devstack sudo[107034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-27aa8476-57db-4310-903b-e039dd4d04a1
Sep 09 04:10:38 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:38 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-27aa8476-57db-4310-903b-e039dd4d04a1" returned: 0 in 0.285s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Lock "cinder-quobyte-27aa8476-57db-4310-903b-e039dd4d04a1" released by "delete_volume" :: held 0.788s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Created reservations ['97b8e566-f4e7-444c-a233-bc1debc991f6', '77c0d2fa-468b-446a-be57-8ebc24a1db2a', 'aa6d476f-01c1-400a-baed-b7874f2663a1', '65e8a2be-628d-4138-b6e4-a559587ec3c0'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:38 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:38 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:38 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac 1073741824" returned: 0 in 0.512s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:38 devstack sudo[107044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac
Sep 09 04:10:38 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:38 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.299s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:38 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Deleted volume successfully.
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dc741ecc-edac-46af-abd9-260892a8f047 tempest-ProjectReaderTests-613364189 None] Lock "cinder-27aa8476-57db-4310-903b-e039dd4d04a1-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:38 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac" returned: 0 in 0.361s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc139df-2b0b-43e4-8894-3074ffb79b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:38 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b927aa32-0039-4ab7-a441-0bb2ae7b99b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:39 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Volume volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac (04de66af-f05c-4ec9-b68a-d70c5c5093ac): created successfully
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b927aa32-0039-4ab7-a441-0bb2ae7b99b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (ff93563d-247b-42fc-ab49-dfa84d853e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:39 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7a2544b4-3ae1-436c-8ee2-3b685abed714 tempest-ProjectMemberTests-1716548698 None] Created volume successfully.
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Flow 'volume_create_manager' (81d4c5ee-2a0b-4adb-a4c6-cc8c95bdbf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b83629-e06d-47c9-a63f-bf01474a2002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b83629-e06d-47c9-a63f-bf01474a2002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-16680961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b974689e-4f3f-484a-83b0-cc3c86c9b51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946fba4b50994061a81dd9a2f4a44a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:39Z,use_quota=True,user_id='996521c8e22c4927bfbbb277519f6506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bf96d3-ef85-4c76-9da9-97cbd6ede4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bf96d3-ef85-4c76-9da9-97cbd6ede4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3c95d6-a42a-44b7-942f-e921e12fe4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3c95d6-a42a-44b7-942f-e921e12fe4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b974689e-4f3f-484a-83b0-cc3c86c9b51a', 'volume_name': 'volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fd0565-0893-4e6e-84f8-1a46abe1132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fd0565-0893-4e6e-84f8-1a46abe1132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d4aad3-3ebe-4e23-874c-1f3af175e09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:39 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Volume b974689e-4f3f-484a-83b0-cc3c86c9b51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a', 'volume_size': 1}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-16680961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b974689e-4f3f-484a-83b0-cc3c86c9b51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946fba4b50994061a81dd9a2f4a44a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:39Z,use_quota=True,user_id='996521c8e22c4927bfbbb277519f6506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Creating volume b974689e-4f3f-484a-83b0-cc3c86c9b51a {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:39 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:39 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a 1073741824
Sep 09 04:10:39 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:39 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a 1073741824" returned: 0 in 0.382s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:39 devstack sudo[107053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a
Sep 09 04:10:39 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:40 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a" returned: 0 in 0.254s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d4aad3-3ebe-4e23-874c-1f3af175e09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d7c4a9-5ca4-4458-b7d8-08c4501e7d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:40 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Volume volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a (b974689e-4f3f-484a-83b0-cc3c86c9b51a): created successfully
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d7c4a9-5ca4-4458-b7d8-08c4501e7d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Flow 'volume_create_manager' (81d4c5ee-2a0b-4adb-a4c6-cc8c95bdbf04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:40 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-fa660caa-b5b7-42ad-a870-1c2655c46d00 tempest-ProjectReaderTests-613364189 None] Created volume successfully.
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] Creating offline snapshot c2e0c6e8-4b3a-4775-8bce-5aef717bede6 of volume 04de66af-f05c-4ec9-b68a-d70c5c5093ac {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b3aeff-3846-466a-8c38-ad0b3e4fbb6f]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Acquiring lock "cinder-b974689e-4f3f-484a-83b0-cc3c86c9b51a-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Lock "cinder-b974689e-4f3f-484a-83b0-cc3c86c9b51a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:40 devstack sudo[107056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac
Sep 09 04:10:40 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Acquiring lock "cinder-quobyte-b974689e-4f3f-484a-83b0-cc3c86c9b51a" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Lock "cinder-quobyte-b974689e-4f3f-484a-83b0-cc3c86c9b51a" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[beca6d3c-8f15-44cc-a7e9-13fb3fc5b1f3]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:40 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a
Sep 09 04:10:40 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:40 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac" returned: 0 in 0.365s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:40 devstack sudo[107063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6 1G
Sep 09 04:10:40 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:40 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a" returned: 0 in 0.373s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:40 devstack sudo[107068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a
Sep 09 04:10:40 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:40 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6 1G" returned: 0 in 0.384s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:41 devstack sudo[107073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6
Sep 09 04:10:41 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:41 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-b974689e-4f3f-484a-83b0-cc3c86c9b51a" returned: 0 in 0.251s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Lock "cinder-quobyte-b974689e-4f3f-484a-83b0-cc3c86c9b51a" released by "delete_volume" :: held 0.664s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Created reservations ['464e8a74-c092-4339-8755-36df81db58c3', 'eac6dfff-47f6-4a51-8c10-799ad6682836', 'd3c55726-2641-4bf1-8b7b-f02a26e1735c', 'fef0c9bf-fa29-40e3-a9e8-0931768c1ed6'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:41 devstack sudo[107076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:41 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:41 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6" returned: 0 in 0.304s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:41 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6 is being set with open permissions: ugo+rw
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:41 devstack sudo[107081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6
Sep 09 04:10:41 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:41 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.261s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:41 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Deleted volume successfully.
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-2b399bf2-7667-490f-a46a-3226cd725bc9 tempest-ProjectReaderTests-613364189 None] Lock "cinder-b974689e-4f3f-484a-83b0-cc3c86c9b51a-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:41 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6" returned: 0 in 0.262s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:41 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.info
Sep 09 04:10:41 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:41 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.info" returned: 0 in 0.253s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:41 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.info is being set with open permissions: ugo+rw
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:41 devstack sudo[107088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.info
Sep 09 04:10:41 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Flow 'volume_create_manager' (3b667f91-91cb-4122-8b12-0b9b4a523d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:41 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7100d0-52bb-46b4-be17-4a1e9c443f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7100d0-52bb-46b4-be17-4a1e9c443f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593075528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965ec849-fffc-46db-a67a-eb8061093efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946fba4b50994061a81dd9a2f4a44a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:42Z,use_quota=True,user_id='996521c8e22c4927bfbbb277519f6506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1ac5d3-57a4-4daf-8f09-fcb776ec074a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1ac5d3-57a4-4daf-8f09-fcb776ec074a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cfc6ea-dc6e-4ac5-9f99-589b42309a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cfc6ea-dc6e-4ac5-9f99-589b42309a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '965ec849-fffc-46db-a67a-eb8061093efc', 'volume_name': 'volume-965ec849-fffc-46db-a67a-eb8061093efc', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce44a801-7eb9-41ac-9448-9da2ff9a887a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce44a801-7eb9-41ac-9448-9da2ff9a887a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5825312b-7d5c-4ecd-a876-cd570d2c4a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:42 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Volume 965ec849-fffc-46db-a67a-eb8061093efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-965ec849-fffc-46db-a67a-eb8061093efc', 'volume_size': 1}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:42 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.info" returned: 0 in 0.247s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593075528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965ec849-fffc-46db-a67a-eb8061093efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946fba4b50994061a81dd9a2f4a44a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:42Z,use_quota=True,user_id='996521c8e22c4927bfbbb277519f6506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Creating volume 965ec849-fffc-46db-a67a-eb8061093efc {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:42 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-965ec849-fffc-46db-a67a-eb8061093efc 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:42 devstack sudo[107091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-965ec849-fffc-46db-a67a-eb8061093efc 1073741824
Sep 09 04:10:42 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:42 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-48b6e71d-41b4-4622-a8a5-ec7ff1aae29c tempest-ProjectMemberTests-1716548698 None] Create snapshot completed successfully
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-c2e0c6e8-4b3a-4775-8bce-5aef717bede6-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Lock "cinder-c2e0c6e8-4b3a-4775-8bce-5aef717bede6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-04de66af-f05c-4ec9-b68a-d70c5c5093ac" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-04de66af-f05c-4ec9-b68a-d70c5c5093ac" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-c2e0c6e8-4b3a-4775-8bce-5aef717bede6" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-c2e0c6e8-4b3a-4775-8bce-5aef717bede6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Deleting offline snapshot c2e0c6e8-4b3a-4775-8bce-5aef717bede6 of volume 04de66af-f05c-4ec9-b68a-d70c5c5093ac {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] snapshot_file for this snap is: volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa72f09-58e3-4bed-9f3c-e313c6d956ea]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:42 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6
Sep 09 04:10:42 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:42 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-965ec849-fffc-46db-a67a-eb8061093efc 1073741824" returned: 0 in 0.446s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-965ec849-fffc-46db-a67a-eb8061093efc {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:42 devstack sudo[107099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-965ec849-fffc-46db-a67a-eb8061093efc
Sep 09 04:10:42 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:42 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6" returned: 0 in 0.373s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e364f8f0-113b-41cb-ac3a-826f88b6d6d2]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:42 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-965ec849-fffc-46db-a67a-eb8061093efc" returned: 0 in 0.246s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5825312b-7d5c-4ecd-a876-cd570d2c4a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-965ec849-fffc-46db-a67a-eb8061093efc', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef94897-aaba-40c2-a0c7-ed342c329aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:42 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Volume volume-965ec849-fffc-46db-a67a-eb8061093efc (965ec849-fffc-46db-a67a-eb8061093efc): created successfully
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef94897-aaba-40c2-a0c7-ed342c329aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:42 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Flow 'volume_create_manager' (3b667f91-91cb-4122-8b12-0b9b4a523d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:42 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-7899c82d-9073-41a2-8ad2-e101e6bf9aa0 tempest-ProjectReaderTests-613364189 None] Created volume successfully.
Sep 09 04:10:42 devstack sudo[107105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac
Sep 09 04:10:42 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:43 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac" returned: 0 in 0.382s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:43 devstack sudo[107110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6
Sep 09 04:10:43 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:43 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6" returned: 0 in 0.324s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:43 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6
Sep 09 04:10:43 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:43 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac.c2e0c6e8-4b3a-4775-8bce-5aef717bede6" returned: 0 in 0.247s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-c2e0c6e8-4b3a-4775-8bce-5aef717bede6" released by "_delete_snapshot" :: held 1.407s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-04de66af-f05c-4ec9-b68a-d70c5c5093ac" released by "delete_snapshot" :: held 1.429s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:43 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Created reservations ['e33f7978-6b05-458a-977d-00b6f4e48aa3', '36fc79e4-5d67-4ff4-ae0b-93ac85892651', '8a8b9862-5009-430e-a2a3-084f759f46ef', '07921e94-6371-4c75-ad41-0e3c8403963a'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:43 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Delete snapshot completed successfully.
Sep 09 04:10:43 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-3e94b029-50e9-44c2-b7a8-29d91f38a2ca tempest-ProjectMemberTests-1716548698 None] Lock "cinder-c2e0c6e8-4b3a-4775-8bce-5aef717bede6-delete_snapshot" released by "delete_snapshot" :: held 1.566s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Acquiring lock "cinder-965ec849-fffc-46db-a67a-eb8061093efc-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Lock "cinder-965ec849-fffc-46db-a67a-eb8061093efc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Acquiring lock "cinder-quobyte-965ec849-fffc-46db-a67a-eb8061093efc" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Lock "cinder-quobyte-965ec849-fffc-46db-a67a-eb8061093efc" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b62bdab-9f91-4bf0-af9e-5828fa473502]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-965ec849-fffc-46db-a67a-eb8061093efc {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:44 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-965ec849-fffc-46db-a67a-eb8061093efc
Sep 09 04:10:44 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-04de66af-f05c-4ec9-b68a-d70c5c5093ac-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Lock "cinder-04de66af-f05c-4ec9-b68a-d70c5c5093ac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:44 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-04de66af-f05c-4ec9-b68a-d70c5c5093ac" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-965ec849-fffc-46db-a67a-eb8061093efc" returned: 0 in 0.378s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-965ec849-fffc-46db-a67a-eb8061093efc {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-04de66af-f05c-4ec9-b68a-d70c5c5093ac" acquired by "delete_volume" :: waited 0.030s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:44 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-965ec849-fffc-46db-a67a-eb8061093efc
Sep 09 04:10:44 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[18449462-6b06-4582-8ff4-88ce7673c6d5]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:44 devstack sudo[107125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac
Sep 09 04:10:44 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:44 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-965ec849-fffc-46db-a67a-eb8061093efc" returned: 0 in 0.249s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Lock "cinder-quobyte-965ec849-fffc-46db-a67a-eb8061093efc" released by "delete_volume" :: held 0.663s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Created reservations ['dca7b15e-b338-4b4a-8bb0-4bfe6b389bb3', 'af367578-e66c-43a8-a6c8-355cd6005000', 'aa163804-946b-4a8e-a90f-013057310dc0', '5b8b4b44-1b81-4489-a9c1-e9debc46f24f'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:44 devstack sudo[107130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:44 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:44 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac" returned: 0 in 0.370s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:45 devstack sudo[107133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac
Sep 09 04:10:45 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:45 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.266s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:45 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Deleted volume successfully.
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-d7b3367f-8742-4ffc-aef1-cd9d1887d63a tempest-ProjectReaderTests-613364189 None] Lock "cinder-965ec849-fffc-46db-a67a-eb8061093efc-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:45 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-04de66af-f05c-4ec9-b68a-d70c5c5093ac" returned: 0 in 0.275s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-04de66af-f05c-4ec9-b68a-d70c5c5093ac" released by "delete_volume" :: held 0.708s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Created reservations ['2ce086b5-48a2-439b-b7e5-b0e642c2ecc8', 'a8e56e38-9ce6-41e5-967d-c3f593cea895', '6a84d71b-e2fb-4168-ba26-f9351e90ac16', '062b68d5-afd8-455e-a7d5-2e1670a3837e'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:45 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:45 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:45 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.261s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:45 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Deleted volume successfully.
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-9f0740aa-9643-4737-b487-3e2c7b8962ce tempest-ProjectMemberTests-1716548698 None] Lock "cinder-04de66af-f05c-4ec9-b68a-d70c5c5093ac-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Flow 'volume_create_manager' (44ed066c-24b2-4ddd-a5a8-e2d81659c5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f55617-9de4-45e2-8964-7f2ffa933c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f55617-9de4-45e2-8964-7f2ffa933c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285938162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3406165c-2330-4d59-9570-a4acd23b8a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946fba4b50994061a81dd9a2f4a44a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:46Z,use_quota=True,user_id='996521c8e22c4927bfbbb277519f6506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93f65e5-f06c-459d-bcd4-135950148a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93f65e5-f06c-459d-bcd4-135950148a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135c1607-ac6b-4cec-bb74-79e4d6457dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135c1607-ac6b-4cec-bb74-79e4d6457dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3406165c-2330-4d59-9570-a4acd23b8a1a', 'volume_name': 'volume-3406165c-2330-4d59-9570-a4acd23b8a1a', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38142f3c-e701-4dbd-9391-99d392068e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38142f3c-e701-4dbd-9391-99d392068e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb006f5-8157-4707-814d-1504b4d2cb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:45 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Volume 3406165c-2330-4d59-9570-a4acd23b8a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3406165c-2330-4d59-9570-a4acd23b8a1a', 'volume_size': 1}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285938162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3406165c-2330-4d59-9570-a4acd23b8a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946fba4b50994061a81dd9a2f4a44a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:46Z,use_quota=True,user_id='996521c8e22c4927bfbbb277519f6506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Creating volume 3406165c-2330-4d59-9570-a4acd23b8a1a {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:45 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3406165c-2330-4d59-9570-a4acd23b8a1a 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:45 devstack sudo[107141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3406165c-2330-4d59-9570-a4acd23b8a1a 1073741824
Sep 09 04:10:45 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (631ee76b-7c40-4dcd-b226-32c211c2705d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb13fec-ee11-42c6-9134-f73203f4967e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb13fec-ee11-42c6-9134-f73203f4967e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-826952340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261d78ff-9415-49f3-9dd6-1641664303a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:46Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3686d5-c7d6-48f8-87f6-591bd8b05a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3686d5-c7d6-48f8-87f6-591bd8b05a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc58d43-4a68-4713-ba90-072adc1d756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc58d43-4a68-4713-ba90-072adc1d756a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261d78ff-9415-49f3-9dd6-1641664303a9', 'volume_name': 'volume-261d78ff-9415-49f3-9dd6-1641664303a9', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b03b0e-387f-4962-92c8-fde24a134261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b03b0e-387f-4962-92c8-fde24a134261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352581d4-5680-412d-a308-b9a9e8d6bab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:46 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Volume 261d78ff-9415-49f3-9dd6-1641664303a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261d78ff-9415-49f3-9dd6-1641664303a9', 'volume_size': 1}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:46 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3406165c-2330-4d59-9570-a4acd23b8a1a 1073741824" returned: 0 in 0.437s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3406165c-2330-4d59-9570-a4acd23b8a1a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:46 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3406165c-2330-4d59-9570-a4acd23b8a1a
Sep 09 04:10:46 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:46 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3406165c-2330-4d59-9570-a4acd23b8a1a" returned: 0 in 0.236s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.320s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-826952340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261d78ff-9415-49f3-9dd6-1641664303a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:46Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Creating volume 261d78ff-9415-49f3-9dd6-1641664303a9 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:46 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:46 devstack sudo[107150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9 1073741824
Sep 09 04:10:46 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb006f5-8157-4707-814d-1504b4d2cb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3406165c-2330-4d59-9570-a4acd23b8a1a', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdac895-e3c9-4355-a2e4-5d3dcfb21f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:46 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Volume volume-3406165c-2330-4d59-9570-a4acd23b8a1a (3406165c-2330-4d59-9570-a4acd23b8a1a): created successfully
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdac895-e3c9-4355-a2e4-5d3dcfb21f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Flow 'volume_create_manager' (44ed066c-24b2-4ddd-a5a8-e2d81659c5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:46 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d347a099-935a-4ccf-993e-d8be075c873c tempest-ProjectReaderTests-613364189 None] Created volume successfully.
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Acquiring lock "cinder-3406165c-2330-4d59-9570-a4acd23b8a1a-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Lock "cinder-3406165c-2330-4d59-9570-a4acd23b8a1a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Acquiring lock "cinder-quobyte-3406165c-2330-4d59-9570-a4acd23b8a1a" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Lock "cinder-quobyte-3406165c-2330-4d59-9570-a4acd23b8a1a" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ada4240-0a61-4c42-877a-ef837b2c5bb4]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3406165c-2330-4d59-9570-a4acd23b8a1a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:47 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3406165c-2330-4d59-9570-a4acd23b8a1a
Sep 09 04:10:47 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:47 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9 1073741824" returned: 0 in 0.444s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:47 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9
Sep 09 04:10:47 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:47 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3406165c-2330-4d59-9570-a4acd23b8a1a" returned: 0 in 0.361s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3406165c-2330-4d59-9570-a4acd23b8a1a {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:47 devstack sudo[107163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3406165c-2330-4d59-9570-a4acd23b8a1a
Sep 09 04:10:47 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:47 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9" returned: 0 in 0.255s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352581d4-5680-412d-a308-b9a9e8d6bab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261d78ff-9415-49f3-9dd6-1641664303a9', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238f60ac-3870-49a1-b9d4-02ad7946fe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:47 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Volume volume-261d78ff-9415-49f3-9dd6-1641664303a9 (261d78ff-9415-49f3-9dd6-1641664303a9): created successfully
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238f60ac-3870-49a1-b9d4-02ad7946fe67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (631ee76b-7c40-4dcd-b226-32c211c2705d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:47 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-9bc9438a-e717-43b6-adbb-950b0a920359 tempest-ProjectMemberTests-1716548698 None] Created volume successfully.
Sep 09 04:10:47 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3406165c-2330-4d59-9570-a4acd23b8a1a" returned: 0 in 0.247s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Lock "cinder-quobyte-3406165c-2330-4d59-9570-a4acd23b8a1a" released by "delete_volume" :: held 0.647s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Created reservations ['68c641a7-5371-4f17-b7ef-3eeb9b683bea', '3c8bf923-3e93-4eb3-9d3a-2b6d710b93d3', '5a327102-0e53-49bf-b3b5-b96464fce3f2', '96c76a06-5b83-49b9-9eda-725ea9e83d18'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:47 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:47 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:47 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.255s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:47 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Deleted volume successfully.
Sep 09 04:10:47 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f73b8e40-e4ca-4dd3-ad5c-a12c78466a24 tempest-ProjectReaderTests-613364189 None] Lock "cinder-3406165c-2330-4d59-9570-a4acd23b8a1a-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:48 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] Creating offline snapshot a03557cf-609d-4186-a49b-b390356673b5 of volume 261d78ff-9415-49f3-9dd6-1641664303a9 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:10:48 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47a2666-dfec-4564-8d3a-3e6ca476db5e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:48 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9
Sep 09 04:10:48 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:48 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9" returned: 0 in 0.378s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:48 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5 1G
Sep 09 04:10:48 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:49 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5 1G" returned: 0 in 0.435s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261d78ff-9415-49f3-9dd6-1641664303a9 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:49 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261d78ff-9415-49f3-9dd6-1641664303a9 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5
Sep 09 04:10:49 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:49 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261d78ff-9415-49f3-9dd6-1641664303a9 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5" returned: 0 in 0.327s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:49 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5 is being set with open permissions: ugo+rw
Sep 09 04:10:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:49 devstack sudo[107184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5
Sep 09 04:10:49 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:49 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5" returned: 0 in 0.248s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:49 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.info
Sep 09 04:10:49 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:50 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.info" returned: 0 in 0.259s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:50 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.info is being set with open permissions: ugo+rw
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:50 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.info
Sep 09 04:10:50 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:50 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.info" returned: 0 in 0.237s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:50 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d9a8e7ab-50b1-4356-b621-276e431f7243 tempest-ProjectMemberTests-1716548698 None] Create snapshot completed successfully
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-a03557cf-609d-4186-a49b-b390356673b5-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-a03557cf-609d-4186-a49b-b390356673b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-261d78ff-9415-49f3-9dd6-1641664303a9" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-261d78ff-9415-49f3-9dd6-1641664303a9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-a03557cf-609d-4186-a49b-b390356673b5" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-a03557cf-609d-4186-a49b-b390356673b5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Deleting offline snapshot a03557cf-609d-4186-a49b-b390356673b5 of volume 261d78ff-9415-49f3-9dd6-1641664303a9 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] snapshot_file for this snap is: volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[8094d00d-54d3-4103-ac77-06cf05df6e42]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:50 devstack sudo[107193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5
Sep 09 04:10:50 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:50 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5" returned: 0 in 0.356s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261d78ff-9415-49f3-9dd6-1641664303a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee2a8fb-f578-4de1-b898-656f837cb4f3]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:51 devstack sudo[107198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9
Sep 09 04:10:51 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:51 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9" returned: 0 in 0.347s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:51 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5
Sep 09 04:10:51 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:51 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5" returned: 0 in 0.340s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:51 devstack sudo[107209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5
Sep 09 04:10:51 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:51 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9.a03557cf-609d-4186-a49b-b390356673b5" returned: 0 in 0.240s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-a03557cf-609d-4186-a49b-b390356673b5" released by "_delete_snapshot" :: held 1.371s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-261d78ff-9415-49f3-9dd6-1641664303a9" released by "delete_snapshot" :: held 1.394s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:51 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Created reservations ['7bd9c5c5-7e87-4b0a-8ce8-747f1c6c6603', '75712520-0e87-4a80-bad9-e6c7f9081a3b', '75f8ed8c-7792-4533-add5-48bb19ce3f5f', '8bb9477c-0f36-46da-a849-1e990ac097a0'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:52 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Delete snapshot completed successfully.
Sep 09 04:10:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-88118f83-df50-4039-8863-c910ba15b874 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-a03557cf-609d-4186-a49b-b390356673b5-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-261d78ff-9415-49f3-9dd6-1641664303a9-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-261d78ff-9415-49f3-9dd6-1641664303a9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-261d78ff-9415-49f3-9dd6-1641664303a9" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-261d78ff-9415-49f3-9dd6-1641664303a9" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:52 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b4c4aa-5517-4fa0-9b3c-39912c43ae01]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:52 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9
Sep 09 04:10:52 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:53 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9" returned: 0 in 0.349s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:53 devstack sudo[107217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9
Sep 09 04:10:53 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:53 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-261d78ff-9415-49f3-9dd6-1641664303a9" returned: 0 in 0.236s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-261d78ff-9415-49f3-9dd6-1641664303a9" released by "delete_volume" :: held 0.641s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Created reservations ['7b5a39c2-c68b-4331-9f89-370340f5cb77', '32ca9c48-4f57-420f-9194-bcbf24fcb6d5', '04b4c714-194d-4234-b069-8fc9dc60433a', '7d6d7f55-1a4d-4f5a-84f0-d584922bf726'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:53 devstack sudo[107220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:10:53 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:53 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.239s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:10:53 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Deleted volume successfully.
Sep 09 04:10:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-557869f3-4531-4bcc-8d94-598c563be886 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-261d78ff-9415-49f3-9dd6-1641664303a9-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (a1e65b69-c559-4c49-9ed0-26d42ef7a189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d7e77c-e820-4ea8-8db9-5e4395fcbb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d7e77c-e820-4ea8-8db9-5e4395fcbb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1258318035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a893bbe7-e36e-4fdc-bee9-c67e5acc45f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:54Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e590a22d-d15b-4b94-bad1-b193ac852ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e590a22d-d15b-4b94-bad1-b193ac852ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5b5bc1-c9ed-4560-a2cd-faf8c418a6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5b5bc1-c9ed-4560-a2cd-faf8c418a6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a893bbe7-e36e-4fdc-bee9-c67e5acc45f7', 'volume_name': 'volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f81050b-5cbc-44fa-a6fd-66e589915180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f81050b-5cbc-44fa-a6fd-66e589915180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1796d05-53c3-4a7e-844c-d4b5cc145ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:54 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Volume a893bbe7-e36e-4fdc-bee9-c67e5acc45f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7', 'volume_size': 1}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1258318035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a893bbe7-e36e-4fdc-bee9-c67e5acc45f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:10:54Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Creating volume a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:10:54 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:54 devstack sudo[107223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 1073741824
Sep 09 04:10:54 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:54 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 1073741824" returned: 0 in 0.401s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:54 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:54 devstack sudo[107228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7
Sep 09 04:10:54 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:55 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7" returned: 0 in 0.237s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1796d05-53c3-4a7e-844c-d4b5cc145ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ece609-c85f-49fa-bacb-a9237a7cbb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:10:55 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Volume volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 (a893bbe7-e36e-4fdc-bee9-c67e5acc45f7): created successfully
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ece609-c85f-49fa-bacb-a9237a7cbb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (a1e65b69-c559-4c49-9ed0-26d42ef7a189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:10:55 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0216cfa1-2df0-4514-977a-7e0369148f48 tempest-ProjectMemberTests-1716548698 None] Created volume successfully.
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] Creating offline snapshot 2d300536-9d77-4824-903b-c5c82a938415 of volume a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eeca6a1-b4e4-41b4-b3f3-55e9674f3f6c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:55 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7
Sep 09 04:10:55 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:55 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7" returned: 0 in 0.350s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:55 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:55 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415 1G
Sep 09 04:10:55 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:56 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415 1G" returned: 0 in 0.383s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:56 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415
Sep 09 04:10:56 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:56 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415" returned: 0 in 0.280s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:56 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415 is being set with open permissions: ugo+rw
Sep 09 04:10:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:56 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415
Sep 09 04:10:56 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:56 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415" returned: 0 in 0.243s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:56 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.info
Sep 09 04:10:56 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:56 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.info" returned: 0 in 0.247s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:56 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.info is being set with open permissions: ugo+rw
Sep 09 04:10:56 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:56 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.info
Sep 09 04:10:56 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:57 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.info" returned: 0 in 0.239s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.815s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:10:57 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-022d9187-0244-4c26-88be-28a8f4a9c250 tempest-ProjectMemberTests-1716548698 None] Create snapshot completed successfully
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-2d300536-9d77-4824-903b-c5c82a938415-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Lock "cinder-2d300536-9d77-4824-903b-c5c82a938415-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-2d300536-9d77-4824-903b-c5c82a938415" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-2d300536-9d77-4824-903b-c5c82a938415" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Deleting offline snapshot 2d300536-9d77-4824-903b-c5c82a938415 of volume a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] snapshot_file for this snap is: volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1db8665-fa22-4fe8-b1f9-5ee36969609e]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:57 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415
Sep 09 04:10:57 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:57 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415" returned: 0 in 0.346s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5871f8-2c45-40dd-bb74-56c559ed423c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:57 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:58 devstack sudo[107262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7
Sep 09 04:10:58 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:58 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7" returned: 0 in 0.356s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:58 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415
Sep 09 04:10:58 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:58 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415" returned: 0 in 0.333s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:58 devstack sudo[107272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415
Sep 09 04:10:58 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:10:58 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root
Sep 09 04:10:58 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7.2d300536-9d77-4824-903b-c5c82a938415" returned: 0 in 0.236s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:10:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-2d300536-9d77-4824-903b-c5c82a938415" released by "_delete_snapshot" :: held 1.362s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:58 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7" released by "delete_snapshot" :: held 1.386s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:58 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Created reservations ['ee0f27c0-19ef-4b93-831f-5deb8935bd45', '42229511-9371-4adc-ac80-ef986b369f9a', '4ad1076e-f88d-4279-b232-d9f6eda6aef8', '95fd92d8-1fee-4d81-91e7-952f54631f90'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:10:59 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Delete snapshot completed successfully.
Sep 09 04:10:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-357b9007-4df0-49d6-acde-e0c87cd5008a tempest-ProjectMemberTests-1716548698 None] Lock "cinder-2d300536-9d77-4824-903b-c5c82a938415-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:10:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Lock "cinder-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:10:59 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:10:59 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71af27b-5fa2-49bc-bb46-541fff5869d7]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:10:59 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:10:59 devstack sudo[107275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7
Sep 09 04:10:59 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:00 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7" returned: 0 in 0.356s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:00 devstack sudo[107280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7
Sep 09 04:11:00 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:00 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7" returned: 0 in 0.242s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7" released by "delete_volume" :: held 0.657s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Created reservations ['7e6ac725-47eb-4bbf-a606-129c33ad8c4d', '7ec7acc7-d810-465a-ad97-6a17d7a84be3', '9ec2d4e4-24f3-457c-828f-424451d01998', '09ba49db-05b6-48a4-859b-6dabae4cad27'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:00 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:11:00 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:00 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.262s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:11:00 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Deleted volume successfully.
Sep 09 04:11:00 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0118273b-a95c-47da-97c6-9d9ba6bfc80e tempest-ProjectMemberTests-1716548698 None] Lock "cinder-a893bbe7-e36e-4fdc-bee9-c67e5acc45f7-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (4603c96d-fbfa-4c31-803c-4f6b18aa2c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9502148-c695-4e35-89d5-d47c73e849ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9502148-c695-4e35-89d5-d47c73e849ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1418744336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3233dd9f-99cc-4884-ab80-1a6fdc538344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:01Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d93b107-682a-4d93-8e69-0c0dea8a5f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d93b107-682a-4d93-8e69-0c0dea8a5f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fcfc943-d148-4b7d-910f-1fb3d81760a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fcfc943-d148-4b7d-910f-1fb3d81760a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3233dd9f-99cc-4884-ab80-1a6fdc538344', 'volume_name': 'volume-3233dd9f-99cc-4884-ab80-1a6fdc538344', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4aa2c1f-6480-420e-b08e-cc67108c2a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4aa2c1f-6480-420e-b08e-cc67108c2a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b98489d-c2fa-4177-8ab4-416ec30a7b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:01 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Volume 3233dd9f-99cc-4884-ab80-1a6fdc538344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3233dd9f-99cc-4884-ab80-1a6fdc538344', 'volume_size': 1}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1418744336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3233dd9f-99cc-4884-ab80-1a6fdc538344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:01Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Creating volume 3233dd9f-99cc-4884-ab80-1a6fdc538344 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:11:01 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:01 devstack sudo[107287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344 1073741824
Sep 09 04:11:01 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:01 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344 1073741824" returned: 0 in 0.393s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:01 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:01 devstack sudo[107293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344
Sep 09 04:11:01 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:02 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344" returned: 0 in 0.244s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b98489d-c2fa-4177-8ab4-416ec30a7b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3233dd9f-99cc-4884-ab80-1a6fdc538344', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3ede1d-4ea1-46a2-8dc1-6a5d31183b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:02 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Volume volume-3233dd9f-99cc-4884-ab80-1a6fdc538344 (3233dd9f-99cc-4884-ab80-1a6fdc538344): created successfully
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3ede1d-4ea1-46a2-8dc1-6a5d31183b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (4603c96d-fbfa-4c31-803c-4f6b18aa2c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:02 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-171d081b-e098-4efa-aed7-3c4d056cd5e3 tempest-ProjectMemberTests-1716548698 None] Created volume successfully.
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] Creating offline snapshot ddf08c58-6924-4242-9b5d-99fb7d547d0c of volume 3233dd9f-99cc-4884-ab80-1a6fdc538344 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[236628c1-94c0-47bb-b268-e50da5569b1d]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:02 devstack sudo[107296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344
Sep 09 04:11:02 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:02 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344" returned: 0 in 0.361s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:02 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:02 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c 1G
Sep 09 04:11:02 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:03 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c 1G" returned: 0 in 0.393s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3233dd9f-99cc-4884-ab80-1a6fdc538344 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:03 devstack sudo[107307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3233dd9f-99cc-4884-ab80-1a6fdc538344 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c
Sep 09 04:11:03 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:03 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3233dd9f-99cc-4884-ab80-1a6fdc538344 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c" returned: 0 in 0.290s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:03 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c is being set with open permissions: ugo+rw
Sep 09 04:11:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:03 devstack sudo[107312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c
Sep 09 04:11:03 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:03 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c" returned: 0 in 0.247s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:03 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:03 devstack sudo[107315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.info
Sep 09 04:11:03 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:04 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.info" returned: 0 in 0.251s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:04 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.info is being set with open permissions: ugo+rw
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:04 devstack sudo[107318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.info
Sep 09 04:11:04 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:04 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.info" returned: 0 in 0.243s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:04 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b4a2a9dd-ab70-4a32-8461-135120702ec8 tempest-ProjectMemberTests-1716548698 None] Create snapshot completed successfully
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-ddf08c58-6924-4242-9b5d-99fb7d547d0c-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Lock "cinder-ddf08c58-6924-4242-9b5d-99fb7d547d0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-3233dd9f-99cc-4884-ab80-1a6fdc538344" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-3233dd9f-99cc-4884-ab80-1a6fdc538344" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-ddf08c58-6924-4242-9b5d-99fb7d547d0c" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-ddf08c58-6924-4242-9b5d-99fb7d547d0c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Deleting offline snapshot ddf08c58-6924-4242-9b5d-99fb7d547d0c of volume 3233dd9f-99cc-4884-ab80-1a6fdc538344 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] snapshot_file for this snap is: volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[484e877c-8a50-4c9f-aa93-b24ff8003bf7]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:04 devstack sudo[107321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c
Sep 09 04:11:04 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:04 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c" returned: 0 in 0.360s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:04 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3233dd9f-99cc-4884-ab80-1a6fdc538344(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:11:05 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1cc8e6-e01d-46ff-ae0d-34c62d6318ce]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:05 devstack sudo[107326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344
Sep 09 04:11:05 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:05 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344" returned: 0 in 0.351s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:05 devstack sudo[107331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c
Sep 09 04:11:05 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:05 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c" returned: 0 in 0.325s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:05 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c
Sep 09 04:11:05 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:05 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:05 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344.ddf08c58-6924-4242-9b5d-99fb7d547d0c" returned: 0 in 0.252s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-ddf08c58-6924-4242-9b5d-99fb7d547d0c" released by "_delete_snapshot" :: held 1.372s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:05 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-3233dd9f-99cc-4884-ab80-1a6fdc538344" released by "delete_snapshot" :: held 1.391s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:06 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Created reservations ['206c9466-eeac-4221-be76-77967ed136f8', '13499e89-9531-4292-a7ab-cb2a9aad27d9', '1ae32cf0-3148-404b-a013-eb10458d46f6', 'fde38c3b-cdd2-49a6-a34a-19b1eeac1de6'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:06 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Delete snapshot completed successfully.
Sep 09 04:11:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-0fc98d22-17f8-4741-a707-8d27bee7463c tempest-ProjectMemberTests-1716548698 None] Lock "cinder-ddf08c58-6924-4242-9b5d-99fb7d547d0c-delete_snapshot" released by "delete_snapshot" :: held 1.516s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-3233dd9f-99cc-4884-ab80-1a6fdc538344-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Lock "cinder-3233dd9f-99cc-4884-ab80-1a6fdc538344-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-3233dd9f-99cc-4884-ab80-1a6fdc538344" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:06 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-3233dd9f-99cc-4884-ab80-1a6fdc538344" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:06 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d2f0da-da30-4883-b442-a9895efab14d]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:06 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:06 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344
Sep 09 04:11:06 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:07 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344" returned: 0 in 0.363s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:07 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344
Sep 09 04:11:07 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:07 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-3233dd9f-99cc-4884-ab80-1a6fdc538344" returned: 0 in 0.236s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-3233dd9f-99cc-4884-ab80-1a6fdc538344" released by "delete_volume" :: held 0.649s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Created reservations ['69dd4de2-fa16-4ba5-836c-ba7d9d27ec80', '9cac1849-d43b-44a1-a127-0dd1ad445846', '58b6130a-4685-4c1b-bf9a-6f0b2011cb49', 'be2bf8ba-820e-45fa-ba07-a2f5818c9d81'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:07 devstack sudo[107349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:11:07 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:07 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.239s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:11:07 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Deleted volume successfully.
Sep 09 04:11:07 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-bb0a3244-c1d9-4ebc-9101-4d6386f2ae7a tempest-ProjectMemberTests-1716548698 None] Lock "cinder-3233dd9f-99cc-4884-ab80-1a6fdc538344-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (129b7ce0-9dd3-4463-92ca-f25806db6706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177db6bf-7db2-4f27-b60c-94ba7d98a90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177db6bf-7db2-4f27-b60c-94ba7d98a90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201290426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958241a5-218a-4fc7-b7cc-252bf82619d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:08Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f01d85-247c-49fc-bf9c-21ce8009a63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f01d85-247c-49fc-bf9c-21ce8009a63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3867461-03c0-4aeb-bfbf-d65a14b038a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3867461-03c0-4aeb-bfbf-d65a14b038a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '958241a5-218a-4fc7-b7cc-252bf82619d4', 'volume_name': 'volume-958241a5-218a-4fc7-b7cc-252bf82619d4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0791372f-4689-4402-9c78-6592f19a1623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0791372f-4689-4402-9c78-6592f19a1623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cb2739-8ce1-484b-8076-74cd5d8cd483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:08 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Volume 958241a5-218a-4fc7-b7cc-252bf82619d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-958241a5-218a-4fc7-b7cc-252bf82619d4', 'volume_size': 1}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201290426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958241a5-218a-4fc7-b7cc-252bf82619d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2badfaed69481ea54534360d166d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:08Z,use_quota=True,user_id='c95e36bb978d4ff2aeb65882d7864c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Creating volume 958241a5-218a-4fc7-b7cc-252bf82619d4 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:11:08 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:08 devstack sudo[107352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4 1073741824
Sep 09 04:11:08 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:08 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4 1073741824" returned: 0 in 0.397s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:08 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:08 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4
Sep 09 04:11:08 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:09 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4" returned: 0 in 0.242s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cb2739-8ce1-484b-8076-74cd5d8cd483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-958241a5-218a-4fc7-b7cc-252bf82619d4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4693ee-3f1e-48d8-98e8-877686381fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:09 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Volume volume-958241a5-218a-4fc7-b7cc-252bf82619d4 (958241a5-218a-4fc7-b7cc-252bf82619d4): created successfully
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4693ee-3f1e-48d8-98e8-877686381fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Flow 'volume_create_manager' (129b7ce0-9dd3-4463-92ca-f25806db6706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:09 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f3bfe86e-aa47-48ea-9673-2e166baf38f7 tempest-ProjectMemberTests-1716548698 None] Created volume successfully.
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] Creating offline snapshot f8b66682-f409-40df-a96f-680084ae2ec7 of volume 958241a5-218a-4fc7-b7cc-252bf82619d4 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d407bf1b-e3b4-4c63-b6e2-49714c112248]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:09 devstack sudo[107360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4
Sep 09 04:11:09 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:09 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4" returned: 0 in 0.353s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:09 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:09 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7 1G
Sep 09 04:11:09 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:10 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7 1G" returned: 0 in 0.389s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958241a5-218a-4fc7-b7cc-252bf82619d4 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:10 devstack sudo[107370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958241a5-218a-4fc7-b7cc-252bf82619d4 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7
Sep 09 04:11:10 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:10 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958241a5-218a-4fc7-b7cc-252bf82619d4 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7" returned: 0 in 0.293s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:10 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7 is being set with open permissions: ugo+rw
Sep 09 04:11:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:10 devstack sudo[107375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7
Sep 09 04:11:10 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:10 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7" returned: 0 in 0.252s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:10 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:10 devstack sudo[107378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.info
Sep 09 04:11:10 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:11 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.info" returned: 0 in 0.270s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:11 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.info is being set with open permissions: ugo+rw
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:11 devstack sudo[107415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.info
Sep 09 04:11:11 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:11 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.info" returned: 0 in 0.274s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.915s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:11 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8876286c-7073-483d-99e6-acf1621b91bf tempest-ProjectMemberTests-1716548698 None] Create snapshot completed successfully
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-f8b66682-f409-40df-a96f-680084ae2ec7-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-f8b66682-f409-40df-a96f-680084ae2ec7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-958241a5-218a-4fc7-b7cc-252bf82619d4" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-958241a5-218a-4fc7-b7cc-252bf82619d4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-f8b66682-f409-40df-a96f-680084ae2ec7" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-f8b66682-f409-40df-a96f-680084ae2ec7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Deleting offline snapshot f8b66682-f409-40df-a96f-680084ae2ec7 of volume 958241a5-218a-4fc7-b7cc-252bf82619d4 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] snapshot_file for this snap is: volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e1cdc9-bc83-477c-9872-77d7ab16a873]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:11 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:11 devstack sudo[107420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7
Sep 09 04:11:11 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:12 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7" returned: 0 in 0.346s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:12 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-958241a5-218a-4fc7-b7cc-252bf82619d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:11:12 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37a2b34-c0ec-490c-b55e-de88b3067184]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:12 devstack sudo[107425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4
Sep 09 04:11:12 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:12 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4" returned: 0 in 0.346s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:12 devstack sudo[107430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7
Sep 09 04:11:12 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:12 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7" returned: 0 in 0.341s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:12 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:12 devstack sudo[107435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7
Sep 09 04:11:12 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:13 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4.f8b66682-f409-40df-a96f-680084ae2ec7" returned: 0 in 0.248s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-f8b66682-f409-40df-a96f-680084ae2ec7" released by "_delete_snapshot" :: held 1.366s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-958241a5-218a-4fc7-b7cc-252bf82619d4" released by "delete_snapshot" :: held 1.388s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:13 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Created reservations ['5ca132c6-9f45-4e77-98d3-09c2b47b0ad6', 'e2e20698-84dc-4a6b-9861-4b96cb134e62', '8399f76b-c448-483b-b857-11e6f2e63bfb', '163ca256-32db-4f65-a7cb-1af2d4c6cd15'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:13 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Delete snapshot completed successfully.
Sep 09 04:11:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-67e62fcf-8bcc-4342-b847-ca56e4713ea9 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-f8b66682-f409-40df-a96f-680084ae2ec7-delete_snapshot" released by "delete_snapshot" :: held 1.522s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-958241a5-218a-4fc7-b7cc-252bf82619d4-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-958241a5-218a-4fc7-b7cc-252bf82619d4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "cinder-quobyte-958241a5-218a-4fc7-b7cc-252bf82619d4" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:13 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-958241a5-218a-4fc7-b7cc-252bf82619d4" acquired by "delete_volume" :: waited 0.013s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:13 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c22cf27-7fe2-4472-949c-d50f9847b9cf]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:13 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:14 devstack sudo[107438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4
Sep 09 04:11:14 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:14 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4" returned: 0 in 0.353s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:14 devstack sudo[107443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4
Sep 09 04:11:14 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:14 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-958241a5-218a-4fc7-b7cc-252bf82619d4" returned: 0 in 0.241s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-quobyte-958241a5-218a-4fc7-b7cc-252bf82619d4" released by "delete_volume" :: held 0.652s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Created reservations ['348b4815-c492-4cc1-96a6-3fa34f369cb7', '591837a0-7942-44d3-97e6-e4c7f062f5ba', '6b3313aa-433a-41a5-8df8-445764000488', 'ce1d9ce8-b57b-463c-bc5e-19b2319bfe59'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:14 devstack sudo[107446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:11:14 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:14 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.264s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:11:14 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Deleted volume successfully.
Sep 09 04:11:14 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae1fcb85-3756-49c8-82b5-1d745bb68c16 tempest-ProjectMemberTests-1716548698 None] Lock "cinder-958241a5-218a-4fc7-b7cc-252bf82619d4-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=208,cinder:SELECT=145,cinder:INSERT=49,cinder:DELETE=14 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:INSERT=61,cinder:UPDATE=212,cinder:SELECT=153,cinder:DELETE=22 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Flow 'volume_create_manager' (4cabfddb-0045-4100-a4d5-07e1dbe404d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fda9d9-3cde-451d-b21b-187a157779ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fda9d9-3cde-451d-b21b-187a157779ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994759656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccde4e6-28c9-46c4-a878-38aa77bd63e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c207a00178a42dfa1ff02ac68fc2c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:18Z,use_quota=True,user_id='d09741974169415ab83172a237ac7bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04850e3c-0b47-4251-9c90-812379d353bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04850e3c-0b47-4251-9c90-812379d353bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9eafc61-498b-44ed-b13d-e6b053946862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9eafc61-498b-44ed-b13d-e6b053946862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fccde4e6-28c9-46c4-a878-38aa77bd63e3', 'volume_name': 'volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265bd517-af20-4cd3-a690-c1e96ff56d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265bd517-af20-4cd3-a690-c1e96ff56d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87b02f7-62b6-4f01-ae49-aed572e6f36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:18 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Volume fccde4e6-28c9-46c4-a878-38aa77bd63e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3', 'volume_size': 1}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994759656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccde4e6-28c9-46c4-a878-38aa77bd63e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c207a00178a42dfa1ff02ac68fc2c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:18Z,use_quota=True,user_id='d09741974169415ab83172a237ac7bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Creating volume fccde4e6-28c9-46c4-a878-38aa77bd63e3 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:11:18 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:18 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3 1073741824
Sep 09 04:11:18 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:18 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3 1073741824" returned: 0 in 0.406s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:18 devstack sudo[107457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3
Sep 09 04:11:18 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:19 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3" returned: 0 in 0.247s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87b02f7-62b6-4f01-ae49-aed572e6f36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b26690-d033-4bcc-975d-b43b151e197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:19 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Volume volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3 (fccde4e6-28c9-46c4-a878-38aa77bd63e3): created successfully
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b26690-d033-4bcc-975d-b43b151e197f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Flow 'volume_create_manager' (4cabfddb-0045-4100-a4d5-07e1dbe404d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:19 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-60b66928-9949-4840-9710-4931ec63e8f8 tempest-ProjectReaderTests-1346484629 None] Created volume successfully.
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] Creating offline snapshot 8bf0eef9-49c1-44ff-b2f5-8148102078ae of volume fccde4e6-28c9-46c4-a878-38aa77bd63e3 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fc47f6-d4b0-445c-947b-f2125be15b43]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:19 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3
Sep 09 04:11:19 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:19 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3" returned: 0 in 0.352s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:19 devstack sudo[107465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae 1G
Sep 09 04:11:19 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:20 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae 1G" returned: 0 in 0.394s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:20 devstack sudo[107470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae
Sep 09 04:11:20 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:20 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae" returned: 0 in 0.297s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:20 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae is being set with open permissions: ugo+rw
Sep 09 04:11:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:20 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae
Sep 09 04:11:20 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:20 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae" returned: 0 in 0.241s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:20 devstack sudo[107478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.info
Sep 09 04:11:20 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:21 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.info" returned: 0 in 0.261s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:21 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.info is being set with open permissions: ugo+rw
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:21 devstack sudo[107481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.info
Sep 09 04:11:21 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:21 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.info" returned: 0 in 0.237s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:21 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-89d8bcae-0dbc-4c16-905e-11c57977d697 tempest-ProjectReaderTests-1346484629 None] Create snapshot completed successfully
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-8bf0eef9-49c1-44ff-b2f5-8148102078ae-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-8bf0eef9-49c1-44ff-b2f5-8148102078ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-fccde4e6-28c9-46c4-a878-38aa77bd63e3" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-fccde4e6-28c9-46c4-a878-38aa77bd63e3" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-8bf0eef9-49c1-44ff-b2f5-8148102078ae" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-8bf0eef9-49c1-44ff-b2f5-8148102078ae" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Deleting offline snapshot 8bf0eef9-49c1-44ff-b2f5-8148102078ae of volume fccde4e6-28c9-46c4-a878-38aa77bd63e3 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] snapshot_file for this snap is: volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd37e023-760e-4d0a-b3cc-c3a2afc47950]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:22 devstack sudo[107484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae
Sep 09 04:11:22 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:22 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae" returned: 0 in 0.362s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:22 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:11:22 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1486844f-f044-4cf1-b270-4838d16c801b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:22 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3
Sep 09 04:11:22 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:22 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3" returned: 0 in 0.342s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:22 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae
Sep 09 04:11:22 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:22 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae" returned: 0 in 0.318s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:22 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:23 devstack sudo[107499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae
Sep 09 04:11:23 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:23 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:23 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3.8bf0eef9-49c1-44ff-b2f5-8148102078ae" returned: 0 in 0.259s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-8bf0eef9-49c1-44ff-b2f5-8148102078ae" released by "_delete_snapshot" :: held 1.360s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-fccde4e6-28c9-46c4-a878-38aa77bd63e3" released by "delete_snapshot" :: held 1.380s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:23 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Created reservations ['59db8865-08f9-4603-8de4-10849994e9d2', 'c2cf86eb-e925-4ab1-8721-6dd1a34b9b2a', 'ba3b3c96-89c3-47a8-99e7-e71b7375effa', '3ba2fae5-643a-4f0c-94f9-95717d5cac4a'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:23 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Delete snapshot completed successfully.
Sep 09 04:11:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-a949d44d-8477-475b-b0b7-9978ebb34913 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-8bf0eef9-49c1-44ff-b2f5-8148102078ae-delete_snapshot" released by "delete_snapshot" :: held 1.544s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-fccde4e6-28c9-46c4-a878-38aa77bd63e3-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:23 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Lock "cinder-fccde4e6-28c9-46c4-a878-38aa77bd63e3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-fccde4e6-28c9-46c4-a878-38aa77bd63e3" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-fccde4e6-28c9-46c4-a878-38aa77bd63e3" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56ab004-7685-43e9-9834-adf7952fc181]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:24 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3
Sep 09 04:11:24 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:24 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3" returned: 0 in 0.353s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:24 devstack sudo[107513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3
Sep 09 04:11:24 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:24 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-fccde4e6-28c9-46c4-a878-38aa77bd63e3" returned: 0 in 0.238s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-fccde4e6-28c9-46c4-a878-38aa77bd63e3" released by "delete_volume" :: held 0.643s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Created reservations ['299f29b1-a688-4454-b45c-878d724776af', '784ebd9f-d212-43a9-b476-22ffe9749576', '6b3c419e-1647-44f5-a618-478332bdce4b', '11cf78f5-4886-4480-a97b-22972f14422d'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:24 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:24 devstack sudo[107516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:11:24 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:25 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.239s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:11:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Deleted volume successfully.
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-caef8a26-3991-4e76-8b00-a47c0f73f3cd tempest-ProjectReaderTests-1346484629 None] Lock "cinder-fccde4e6-28c9-46c4-a878-38aa77bd63e3-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Flow 'volume_create_manager' (b924a7f7-6f20-4753-bcb8-550b88769329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03e4671-4ac3-4607-8d22-7d8e000331c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03e4671-4ac3-4607-8d22-7d8e000331c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267559068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c207a00178a42dfa1ff02ac68fc2c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:25Z,use_quota=True,user_id='d09741974169415ab83172a237ac7bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f72e711-2810-4b4f-aa40-d412445a7db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f72e711-2810-4b4f-aa40-d412445a7db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fe23ad-3adc-4943-80c4-e0b451823a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fe23ad-3adc-4943-80c4-e0b451823a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74', 'volume_name': 'volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e498c43-c4af-4259-95de-924cf057e774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e498c43-c4af-4259-95de-924cf057e774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642d7ff0-4806-4f95-8051-eb1f45b366d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:25 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Volume d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74', 'volume_size': 1}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267559068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c207a00178a42dfa1ff02ac68fc2c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:25Z,use_quota=True,user_id='d09741974169415ab83172a237ac7bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Creating volume d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:11:25 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:11:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:25 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 1073741824
Sep 09 04:11:25 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:26 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 1073741824" returned: 0 in 0.402s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:26 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74
Sep 09 04:11:26 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:26 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74" returned: 0 in 0.243s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642d7ff0-4806-4f95-8051-eb1f45b366d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a13b7a0-d34a-47f3-937a-44fa5eb22faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:26 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Volume volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 (d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74): created successfully
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a13b7a0-d34a-47f3-937a-44fa5eb22faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Flow 'volume_create_manager' (b924a7f7-6f20-4753-bcb8-550b88769329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:26 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-06a2ba31-6eb5-459c-84a8-311cb6c5c1cb tempest-ProjectReaderTests-1346484629 None] Created volume successfully.
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] Creating offline snapshot cb08dc07-d29e-4bea-a7e7-689752cc38aa of volume d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1433652-0429-40a3-9bc2-0affbd93adec]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:26 devstack sudo[107529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74
Sep 09 04:11:26 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:27 devstack sudo[107532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:11:27 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:27 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74" returned: 0 in 0.362s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:27 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa 1G
Sep 09 04:11:27 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:27 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.244s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:11:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:11:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 04:11:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 04:11:27 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa 1G" returned: 0 in 0.369s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:27 devstack sudo[107543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa
Sep 09 04:11:27 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:27 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa" returned: 0 in 0.286s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:27 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa is being set with open permissions: ugo+rw
Sep 09 04:11:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:27 devstack sudo[107548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa
Sep 09 04:11:27 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:27 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa" returned: 0 in 0.241s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:28 devstack sudo[107551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.info
Sep 09 04:11:28 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:28 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.info" returned: 0 in 0.253s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:28 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.info is being set with open permissions: ugo+rw
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:28 devstack sudo[107554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.info
Sep 09 04:11:28 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:28 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.info" returned: 0 in 0.242s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:28 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-1eb8aaf3-d3b5-4a18-af1f-4ba0bfda303a tempest-ProjectReaderTests-1346484629 None] Create snapshot completed successfully
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-cb08dc07-d29e-4bea-a7e7-689752cc38aa-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Lock "cinder-cb08dc07-d29e-4bea-a7e7-689752cc38aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-cb08dc07-d29e-4bea-a7e7-689752cc38aa" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-cb08dc07-d29e-4bea-a7e7-689752cc38aa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Deleting offline snapshot cb08dc07-d29e-4bea-a7e7-689752cc38aa of volume d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] snapshot_file for this snap is: volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad72076-b852-4476-a19b-84f1757eb7a4]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:29 devstack sudo[107557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa
Sep 09 04:11:29 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:29 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa" returned: 0 in 0.364s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:11:29 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb25c92-c006-4146-baf4-a8d4db9fdfe8]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:29 devstack sudo[107562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74
Sep 09 04:11:29 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:29 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74" returned: 0 in 0.343s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:29 devstack sudo[107567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa
Sep 09 04:11:29 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:29 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa" returned: 0 in 0.332s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:29 devstack sudo[107572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa
Sep 09 04:11:29 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:30 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74.cb08dc07-d29e-4bea-a7e7-689752cc38aa" returned: 0 in 0.253s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-cb08dc07-d29e-4bea-a7e7-689752cc38aa" released by "_delete_snapshot" :: held 1.374s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74" released by "delete_snapshot" :: held 1.396s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:30 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Created reservations ['1fdefa5b-9fc4-4bd8-a010-fd631809cbb9', 'fa3fd4d8-63e8-4538-bdd9-334da34e79a2', '0d1e0618-ba77-48d2-a686-850e4b016f63', '1d81dbd9-c57a-4946-828b-8130927cecad'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Delete snapshot completed successfully.
Sep 09 04:11:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ae0e6ebf-ff61-47f9-9954-1ea67b5ea30a tempest-ProjectReaderTests-1346484629 None] Lock "cinder-cb08dc07-d29e-4bea-a7e7-689752cc38aa-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Lock "cinder-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74" acquired by "delete_volume" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f330ccb-f034-4be6-be37-0549c248add1]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:31 devstack sudo[107575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74
Sep 09 04:11:31 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:31 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74" returned: 0 in 0.354s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:31 devstack sudo[107580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74
Sep 09 04:11:31 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:31 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74" returned: 0 in 0.248s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74" released by "delete_volume" :: held 0.656s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Created reservations ['1ea42a2c-0782-426a-b291-663de8b52145', 'c08c7435-8420-457d-b536-43b5760610b8', 'ee27b89a-5d39-4bdf-9091-7f46149e561e', 'f51f2014-ae1a-44f8-8a7a-d5e533cdf1b9'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:31 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:31 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:11:31 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:32 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.239s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:11:32 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Deleted volume successfully.
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-f06162c2-5354-4b79-b4ef-afb5a1080e3f tempest-ProjectReaderTests-1346484629 None] Lock "cinder-d3a5b875-3a3f-4ee9-b4d1-2b6a8923bb74-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Flow 'volume_create_manager' (a2ba8d2b-f0bd-4e67-ba56-71e6c3664958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4effeee-aea7-4af5-86a5-70b4d53353eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4effeee-aea7-4af5-86a5-70b4d53353eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144168704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736c33e9-85f4-402e-bec8-eb411ab4e96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c207a00178a42dfa1ff02ac68fc2c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:32Z,use_quota=True,user_id='d09741974169415ab83172a237ac7bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b7df5b-ad41-48e8-996b-7eb3c15f2307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b7df5b-ad41-48e8-996b-7eb3c15f2307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f11e9be-a438-4feb-98bf-77676a00cf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f11e9be-a438-4feb-98bf-77676a00cf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '736c33e9-85f4-402e-bec8-eb411ab4e96e', 'volume_name': 'volume-736c33e9-85f4-402e-bec8-eb411ab4e96e', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec57b1a-cbb5-40a3-9cef-698b4117b11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec57b1a-cbb5-40a3-9cef-698b4117b11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a78a748-dae7-446d-8b7f-d0387ab035df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:32 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Volume 736c33e9-85f4-402e-bec8-eb411ab4e96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-736c33e9-85f4-402e-bec8-eb411ab4e96e', 'volume_size': 1}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144168704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736c33e9-85f4-402e-bec8-eb411ab4e96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c207a00178a42dfa1ff02ac68fc2c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:32Z,use_quota=True,user_id='d09741974169415ab83172a237ac7bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Creating volume 736c33e9-85f4-402e-bec8-eb411ab4e96e {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:11:32 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:11:32 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:32 devstack sudo[107587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e 1073741824
Sep 09 04:11:32 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:33 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e 1073741824" returned: 0 in 0.407s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:33 devstack sudo[107593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e
Sep 09 04:11:33 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:33 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e" returned: 0 in 0.238s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a78a748-dae7-446d-8b7f-d0387ab035df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-736c33e9-85f4-402e-bec8-eb411ab4e96e', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816f9988-26d8-44bd-9c4c-878c8be1bbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:33 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Volume volume-736c33e9-85f4-402e-bec8-eb411ab4e96e (736c33e9-85f4-402e-bec8-eb411ab4e96e): created successfully
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816f9988-26d8-44bd-9c4c-878c8be1bbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Flow 'volume_create_manager' (a2ba8d2b-f0bd-4e67-ba56-71e6c3664958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:33 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0380feee-9bac-4824-998b-eb98b6a5cee2 tempest-ProjectReaderTests-1346484629 None] Created volume successfully.
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] Creating offline snapshot b54eeb49-c4b5-446b-8388-a03ec0e3c050 of volume 736c33e9-85f4-402e-bec8-eb411ab4e96e {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f728f8-c16b-4da4-be0c-9bdb08d520ab]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:33 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:33 devstack sudo[107596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e
Sep 09 04:11:33 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:34 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e" returned: 0 in 0.352s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:34 devstack sudo[107601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050 1G
Sep 09 04:11:34 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:34 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050 1G" returned: 0 in 0.370s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-736c33e9-85f4-402e-bec8-eb411ab4e96e -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:34 devstack sudo[107606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-736c33e9-85f4-402e-bec8-eb411ab4e96e -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050
Sep 09 04:11:34 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:34 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-736c33e9-85f4-402e-bec8-eb411ab4e96e -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050" returned: 0 in 0.287s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:34 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050 is being set with open permissions: ugo+rw
Sep 09 04:11:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:34 devstack sudo[107611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050
Sep 09 04:11:34 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:34 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:34 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050" returned: 0 in 0.241s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:35 devstack sudo[107616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.info
Sep 09 04:11:35 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:35 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.info" returned: 0 in 0.258s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:35 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.info is being set with open permissions: ugo+rw
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:35 devstack sudo[107619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.info
Sep 09 04:11:35 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:35 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.info" returned: 0 in 0.242s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:35 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-c4344fa3-3455-482b-8eea-49b2e4779122 tempest-ProjectReaderTests-1346484629 None] Create snapshot completed successfully
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-b54eeb49-c4b5-446b-8388-a03ec0e3c050-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-b54eeb49-c4b5-446b-8388-a03ec0e3c050-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-736c33e9-85f4-402e-bec8-eb411ab4e96e" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-736c33e9-85f4-402e-bec8-eb411ab4e96e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-b54eeb49-c4b5-446b-8388-a03ec0e3c050" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-b54eeb49-c4b5-446b-8388-a03ec0e3c050" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Deleting offline snapshot b54eeb49-c4b5-446b-8388-a03ec0e3c050 of volume 736c33e9-85f4-402e-bec8-eb411ab4e96e {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] snapshot_file for this snap is: volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1b5a4e-eb5a-48ed-937d-72edfb288493]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:35 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:36 devstack sudo[107623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050
Sep 09 04:11:36 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:36 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050" returned: 0 in 0.361s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:36 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-736c33e9-85f4-402e-bec8-eb411ab4e96e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:11:36 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45bfd28-a519-436c-8bce-e0bfbbe9d6ba]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:36 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e
Sep 09 04:11:36 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:36 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e" returned: 0 in 0.343s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:36 devstack sudo[107633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050
Sep 09 04:11:36 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:36 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050" returned: 0 in 0.327s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:36 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:36 devstack sudo[107638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050
Sep 09 04:11:36 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:37 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:37 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e.b54eeb49-c4b5-446b-8388-a03ec0e3c050" returned: 0 in 0.250s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-b54eeb49-c4b5-446b-8388-a03ec0e3c050" released by "_delete_snapshot" :: held 1.367s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-736c33e9-85f4-402e-bec8-eb411ab4e96e" released by "delete_snapshot" :: held 1.388s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:37 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Created reservations ['03344ed2-bb28-4fb7-9349-358e2c24e73e', '5701b74e-76fb-4cd0-bd99-852fbebac9a0', '6ab2cfc9-622c-401c-95e1-050b3ac92dbd', 'd1e7c5df-cdb6-45ad-a529-36d9aa0cbe3b'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:37 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Delete snapshot completed successfully.
Sep 09 04:11:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e278e911-b188-4dc2-b8ea-58f734707450 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-b54eeb49-c4b5-446b-8388-a03ec0e3c050-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-736c33e9-85f4-402e-bec8-eb411ab4e96e-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:37 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-736c33e9-85f4-402e-bec8-eb411ab4e96e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-736c33e9-85f4-402e-bec8-eb411ab4e96e" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-736c33e9-85f4-402e-bec8-eb411ab4e96e" acquired by "delete_volume" :: waited 0.012s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[882eead6-6ac5-4020-a629-23c2e5f1d415]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:38 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e
Sep 09 04:11:38 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:38 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e" returned: 0 in 0.356s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:38 devstack sudo[107646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e
Sep 09 04:11:38 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:38 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-736c33e9-85f4-402e-bec8-eb411ab4e96e" returned: 0 in 0.242s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-736c33e9-85f4-402e-bec8-eb411ab4e96e" released by "delete_volume" :: held 0.650s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Created reservations ['94e3329d-9c4b-40b8-8276-cda9f9fed2a8', '37c109fd-4f24-415b-805e-8e944468b74f', '626f778a-4f30-47f7-b0af-c937d7c6de98', '3015f787-3379-4bd1-bab5-b8ac3a26c7f7'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:38 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:38 devstack sudo[107649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:11:38 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:39 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.249s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:11:39 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Deleted volume successfully.
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-b959c653-fccc-4563-aa95-112e440d4a29 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-736c33e9-85f4-402e-bec8-eb411ab4e96e-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Flow 'volume_create_manager' (8e0889d8-eb7a-4792-8708-dcba23dcc8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d453d95-0edb-4712-8005-30ee43ec18d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d453d95-0edb-4712-8005-30ee43ec18d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746804443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e55ce7b2-503e-4a7c-b54c-b519c44c7293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c207a00178a42dfa1ff02ac68fc2c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:40Z,use_quota=True,user_id='d09741974169415ab83172a237ac7bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb414cc9-29ed-4723-815d-ec06ad7c4a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb414cc9-29ed-4723-815d-ec06ad7c4a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffd85f0-db61-442f-a5eb-a01580812646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffd85f0-db61-442f-a5eb-a01580812646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e55ce7b2-503e-4a7c-b54c-b519c44c7293', 'volume_name': 'volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab20b5af-77ef-4b13-bcc0-acb8b7e0eb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab20b5af-77ef-4b13-bcc0-acb8b7e0eb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1acfa78-b097-4cb9-bb98-01fff263525c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:39 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Volume e55ce7b2-503e-4a7c-b54c-b519c44c7293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293', 'volume_size': 1}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746804443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e55ce7b2-503e-4a7c-b54c-b519c44c7293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c207a00178a42dfa1ff02ac68fc2c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:40Z,use_quota=True,user_id='d09741974169415ab83172a237ac7bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Creating volume e55ce7b2-503e-4a7c-b54c-b519c44c7293 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:11:39 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:11:39 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:39 devstack sudo[107652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293 1073741824
Sep 09 04:11:39 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:40 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293 1073741824" returned: 0 in 0.402s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:40 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293
Sep 09 04:11:40 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:40 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293" returned: 0 in 0.242s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1acfa78-b097-4cb9-bb98-01fff263525c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3150af60-f428-4b6a-8f55-efe41091d4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:40 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Volume volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293 (e55ce7b2-503e-4a7c-b54c-b519c44c7293): created successfully
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3150af60-f428-4b6a-8f55-efe41091d4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Flow 'volume_create_manager' (8e0889d8-eb7a-4792-8708-dcba23dcc8cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:40 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-8c274b5e-85e6-47fb-9cbd-b0bd0315a3b3 tempest-ProjectReaderTests-1346484629 None] Created volume successfully.
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] Creating offline snapshot 2c162dce-277d-416d-b924-b439d0f5ecf2 of volume e55ce7b2-503e-4a7c-b54c-b519c44c7293 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[d879ade1-e11c-4e03-82f5-68477afd804b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:40 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:40 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293
Sep 09 04:11:40 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:41 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293" returned: 0 in 0.353s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:41 devstack sudo[107665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2 1G
Sep 09 04:11:41 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:41 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2 1G" returned: 0 in 0.377s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:41 devstack sudo[107670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2
Sep 09 04:11:41 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:41 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2" returned: 0 in 0.298s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:41 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2 is being set with open permissions: ugo+rw
Sep 09 04:11:41 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:41 devstack sudo[107676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2
Sep 09 04:11:41 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:42 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2" returned: 0 in 0.240s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:42 devstack sudo[107679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.info
Sep 09 04:11:42 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:42 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.info" returned: 0 in 0.250s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:42 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.info is being set with open permissions: ugo+rw
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:42 devstack sudo[107682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.info
Sep 09 04:11:42 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:42 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.info" returned: 0 in 0.235s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:42 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-d00d2cc1-f1b0-403f-b74a-55dd679e41e1 tempest-ProjectReaderTests-1346484629 None] Create snapshot completed successfully
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-2c162dce-277d-416d-b924-b439d0f5ecf2-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-2c162dce-277d-416d-b924-b439d0f5ecf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-e55ce7b2-503e-4a7c-b54c-b519c44c7293" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-e55ce7b2-503e-4a7c-b54c-b519c44c7293" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-2c162dce-277d-416d-b924-b439d0f5ecf2" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-2c162dce-277d-416d-b924-b439d0f5ecf2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Deleting offline snapshot 2c162dce-277d-416d-b924-b439d0f5ecf2 of volume e55ce7b2-503e-4a7c-b54c-b519c44c7293 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] snapshot_file for this snap is: volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cee54c-e780-443d-ad65-6f867f44ce7c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:42 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:43 devstack sudo[107685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2
Sep 09 04:11:43 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:43 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2" returned: 0 in 0.353s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:43 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:11:43 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47fbcf9-e9d8-4939-b7d6-12e72e5519fb]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:43 devstack sudo[107690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293
Sep 09 04:11:43 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:43 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293" returned: 0 in 0.342s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:43 devstack sudo[107695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2
Sep 09 04:11:43 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:43 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2" returned: 0 in 0.336s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:43 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:43 devstack sudo[107700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2
Sep 09 04:11:43 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:44 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:44 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293.2c162dce-277d-416d-b924-b439d0f5ecf2" returned: 0 in 0.244s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-2c162dce-277d-416d-b924-b439d0f5ecf2" released by "_delete_snapshot" :: held 1.356s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-e55ce7b2-503e-4a7c-b54c-b519c44c7293" released by "delete_snapshot" :: held 1.376s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:44 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Created reservations ['29026a9b-b810-4317-9dcb-6f4c68587036', '15fba4a2-de58-4802-9c31-3f94d8f109b0', '116a2efe-5ad7-4801-8301-1edc022cd839', '54afab5c-4d51-4a31-85e3-ab2cd5f8664c'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:44 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Delete snapshot completed successfully.
Sep 09 04:11:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-ef689efa-5545-475d-83fd-bf5bf7297c59 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-2c162dce-277d-416d-b924-b439d0f5ecf2-delete_snapshot" released by "delete_snapshot" :: held 1.498s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-e55ce7b2-503e-4a7c-b54c-b519c44c7293-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:44 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Lock "cinder-e55ce7b2-503e-4a7c-b54c-b519c44c7293-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-e55ce7b2-503e-4a7c-b54c-b519c44c7293" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-e55ce7b2-503e-4a7c-b54c-b519c44c7293" acquired by "delete_volume" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec8f4a5-c1e9-4c2f-baf4-f2409477b00b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:45 devstack sudo[107703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293
Sep 09 04:11:45 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:45 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293" returned: 0 in 0.355s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:45 devstack sudo[107708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293
Sep 09 04:11:45 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:45 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-e55ce7b2-503e-4a7c-b54c-b519c44c7293" returned: 0 in 0.239s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-e55ce7b2-503e-4a7c-b54c-b519c44c7293" released by "delete_volume" :: held 0.647s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Created reservations ['d7b81a15-c409-4493-bd78-bdecb20562bb', 'b5a7a9bd-eac5-474e-9852-8d026e5d1431', '42eb408c-8765-427c-a5f8-bd22c428eeaa', '64f7de2b-e738-406a-871e-59763fb97d31'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:45 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:45 devstack sudo[107712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:11:45 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:46 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.258s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:11:46 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Deleted volume successfully.
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-adc7763f-5b5c-496a-a0f9-c1a3e3abd92d tempest-ProjectReaderTests-1346484629 None] Lock "cinder-e55ce7b2-503e-4a7c-b54c-b519c44c7293-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Flow 'volume_create_manager' (7e1641ba-66cb-4795-9906-7992d5041b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ca6401-7821-426b-9634-5863ae30b106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ca6401-7821-426b-9634-5863ae30b106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-709192434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6035f7d6-7ccd-43de-aa17-aca804a43bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c207a00178a42dfa1ff02ac68fc2c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:47Z,use_quota=True,user_id='d09741974169415ab83172a237ac7bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7645a850-b7bf-4147-8f5f-48264904e3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7645a850-b7bf-4147-8f5f-48264904e3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb35cab3-f624-4709-b5b0-a6b06502fb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb35cab3-f624-4709-b5b0-a6b06502fb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6035f7d6-7ccd-43de-aa17-aca804a43bed', 'volume_name': 'volume-6035f7d6-7ccd-43de-aa17-aca804a43bed', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba806597-9454-47ef-afcc-aba25feb3f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba806597-9454-47ef-afcc-aba25feb3f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0cc2b5d-a4de-44df-bb67-191a84f255da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:46 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Volume 6035f7d6-7ccd-43de-aa17-aca804a43bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6035f7d6-7ccd-43de-aa17-aca804a43bed', 'volume_size': 1}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-709192434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6035f7d6-7ccd-43de-aa17-aca804a43bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c207a00178a42dfa1ff02ac68fc2c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:11:47Z,use_quota=True,user_id='d09741974169415ab83172a237ac7bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Creating volume 6035f7d6-7ccd-43de-aa17-aca804a43bed {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:11:46 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:11:46 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:46 devstack sudo[107715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed 1073741824
Sep 09 04:11:46 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:47 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed 1073741824" returned: 0 in 0.397s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:47 devstack sudo[107721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed
Sep 09 04:11:47 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:47 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed" returned: 0 in 0.254s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0cc2b5d-a4de-44df-bb67-191a84f255da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6035f7d6-7ccd-43de-aa17-aca804a43bed', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be88591-4dfa-47fd-aafe-7668cb1b0aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:11:47 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Volume volume-6035f7d6-7ccd-43de-aa17-aca804a43bed (6035f7d6-7ccd-43de-aa17-aca804a43bed): created successfully
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be88591-4dfa-47fd-aafe-7668cb1b0aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Flow 'volume_create_manager' (7e1641ba-66cb-4795-9906-7992d5041b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:11:47 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-0a46743a-4b0c-4269-a2f1-32e496e8df46 tempest-ProjectReaderTests-1346484629 None] Created volume successfully.
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] Creating offline snapshot b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6 of volume 6035f7d6-7ccd-43de-aa17-aca804a43bed {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00b85f3-76bc-4351-be59-944cf5a5305b]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:47 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:47 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed
Sep 09 04:11:47 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:48 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed" returned: 0 in 0.370s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:48 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6 1G
Sep 09 04:11:48 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:48 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6 1G" returned: 0 in 0.376s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6035f7d6-7ccd-43de-aa17-aca804a43bed -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:48 devstack sudo[107737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6035f7d6-7ccd-43de-aa17-aca804a43bed -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6
Sep 09 04:11:48 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:48 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6035f7d6-7ccd-43de-aa17-aca804a43bed -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6" returned: 0 in 0.280s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:48 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6 is being set with open permissions: ugo+rw
Sep 09 04:11:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:48 devstack sudo[107742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6
Sep 09 04:11:48 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:48 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:48 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6" returned: 0 in 0.239s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:49 devstack sudo[107745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.info
Sep 09 04:11:49 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:49 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.info" returned: 0 in 0.245s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:49 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.info is being set with open permissions: ugo+rw
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:49 devstack sudo[107748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.info
Sep 09 04:11:49 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:49 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.info" returned: 0 in 0.232s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.817s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:49 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-a892f635-054e-4c5f-a89a-29af469ce74a tempest-ProjectReaderTests-1346484629 None] Create snapshot completed successfully
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Lock "cinder-b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-6035f7d6-7ccd-43de-aa17-aca804a43bed" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-6035f7d6-7ccd-43de-aa17-aca804a43bed" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Deleting offline snapshot b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6 of volume 6035f7d6-7ccd-43de-aa17-aca804a43bed {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] snapshot_file for this snap is: volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb193695-8e75-4659-a4e8-cc892d00e405]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:49 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:50 devstack sudo[107751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6
Sep 09 04:11:50 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:50 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6" returned: 0 in 0.352s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:50 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6035f7d6-7ccd-43de-aa17-aca804a43bed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:11:50 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[30777b53-da77-4ef8-ac78-a83f9df6cc99]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:50 devstack sudo[107756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed
Sep 09 04:11:50 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:50 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed" returned: 0 in 0.350s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:50 devstack sudo[107761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6
Sep 09 04:11:50 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:50 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6" returned: 0 in 0.323s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:50 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:50 devstack sudo[107766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6
Sep 09 04:11:50 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:51 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:51 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed.b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6" returned: 0 in 0.244s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6" released by "_delete_snapshot" :: held 1.349s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-6035f7d6-7ccd-43de-aa17-aca804a43bed" released by "delete_snapshot" :: held 1.372s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:51 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Created reservations ['4cfd544a-1150-4289-92f9-65bb5018e8f5', '571689ea-a02b-4721-aeda-6cb1236630cd', '4712133a-1179-489d-9b46-a44411cee5ea', '7339f839-e4c0-47fd-a0c0-9b32a4986416'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:51 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Delete snapshot completed successfully.
Sep 09 04:11:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-6ddf7189-a30a-49cf-bab2-b9b1d74d7aab tempest-ProjectReaderTests-1346484629 None] Lock "cinder-b71d18cb-6e91-4cdc-b05c-47c5c2b9b2a6-delete_snapshot" released by "delete_snapshot" :: held 1.497s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-6035f7d6-7ccd-43de-aa17-aca804a43bed-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:51 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-6035f7d6-7ccd-43de-aa17-aca804a43bed-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "cinder-quobyte-6035f7d6-7ccd-43de-aa17-aca804a43bed" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-6035f7d6-7ccd-43de-aa17-aca804a43bed" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[94565dea-e2dd-40c8-957a-739426a31dc8]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:52 devstack sudo[107769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed
Sep 09 04:11:52 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:52 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed" returned: 0 in 0.344s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:52 devstack sudo[107774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed
Sep 09 04:11:52 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:52 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-6035f7d6-7ccd-43de-aa17-aca804a43bed" returned: 0 in 0.243s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-quobyte-6035f7d6-7ccd-43de-aa17-aca804a43bed" released by "delete_volume" :: held 0.637s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Created reservations ['ad268f33-ca7d-4e4a-a97b-2d01a090529f', '5701b05d-53a5-438e-952d-b7c89d9733d9', 'a11df0cf-e2c2-4a02-acf3-a267ca8b6f8b', '00ec42a6-8705-4aa3-b49a-81d3d1cfbf61'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:11:52 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:11:52 devstack sudo[107777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:11:52 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:11:53 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root
Sep 09 04:11:53 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.238s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:11:53 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:11:53 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Deleted volume successfully.
Sep 09 04:11:53 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-528c95f7-c18c-4509-b6fe-07caefa2fee2 tempest-ProjectReaderTests-1346484629 None] Lock "cinder-6035f7d6-7ccd-43de-aa17-aca804a43bed-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:12:02 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=66,cinder:UPDATE=91,cinder:DELETE=5,cinder:INSERT=29 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:12:03 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=73,cinder:INSERT=21,cinder:UPDATE=88,cinder:DELETE=10 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Flow 'volume_create_manager' (8e56d539-a0d8-4b95-9820-9f96e8aab2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0878fed3-dc64-4607-bf84-be13bc9fec5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0878fed3-dc64-4607-bf84-be13bc9fec5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-36028612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa43089-bb3b-4d83-8ea4-5ab8b8beded4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4225416efe5d4b4b84beba52fd15f10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:12:17Z,use_quota=True,user_id='8989f9c55788406f9b8408677aab2b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502491bb-41a5-4c3e-b224-e7bc0e7da8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502491bb-41a5-4c3e-b224-e7bc0e7da8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e43b00d-5410-407f-8e92-e2c9a1942a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e43b00d-5410-407f-8e92-e2c9a1942a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faa43089-bb3b-4d83-8ea4-5ab8b8beded4', 'volume_name': 'volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d7a862-0e44-4acd-8971-f576adb9be71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d7a862-0e44-4acd-8971-f576adb9be71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc6cb86-dccc-4a80-bed7-4958d73f7e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:12:16 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Volume faa43089-bb3b-4d83-8ea4-5ab8b8beded4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4', 'volume_size': 1}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d42c1113ec0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-36028612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa43089-bb3b-4d83-8ea4-5ab8b8beded4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4225416efe5d4b4b84beba52fd15f10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:12:17Z,use_quota=True,user_id='8989f9c55788406f9b8408677aab2b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)}" {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Creating volume faa43089-bb3b-4d83-8ea4-5ab8b8beded4 {{(pid=87558) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:12:16 devstack cinder-volume[87558]: INFO cinder.volume.drivers.remotefs [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] casted to osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc
Sep 09 04:12:16 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 1073741824 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:16 devstack sudo[107821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 1073741824
Sep 09 04:12:16 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:17 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 1073741824" returned: 0 in 0.406s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:17 devstack sudo[107826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4
Sep 09 04:12:17 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:17 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4" returned: 0 in 0.237s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'} {{(pid=87558) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc6cb86-dccc-4a80-bed7-4958d73f7e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4', 'volume_size': 1}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a18d11b-f6f9-4da7-ade4-a286982ba65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:12:17 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Volume volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 (faa43089-bb3b-4d83-8ea4-5ab8b8beded4): created successfully
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a18d11b-f6f9-4da7-ade4-a286982ba65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Flow 'volume_create_manager' (8e56d539-a0d8-4b95-9820-9f96e8aab2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:12:17 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-adbbd00c-cafb-49b4-b2e3-f503d703eaea tempest-SnapshotDependencyTests-95285380 None] Created volume successfully.
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] Creating offline snapshot d14573c4-21f3-4f20-8398-ca4945cb16c7 of volume faa43089-bb3b-4d83-8ea4-5ab8b8beded4 {{(pid=87558) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[df770402-49fd-4d36-8fb5-a325de2b2be5]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:12:17 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:17 devstack sudo[107829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4
Sep 09 04:12:17 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:18 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4" returned: 0 in 0.376s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7 1G {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:18 devstack sudo[107834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7 1G
Sep 09 04:12:18 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:18 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7 1G" returned: 0 in 0.366s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:18 devstack sudo[107839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7
Sep 09 04:12:18 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:18 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 -F qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7" returned: 0 in 0.289s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:18 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7 is being set with open permissions: ugo+rw
Sep 09 04:12:18 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:18 devstack sudo[107844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7
Sep 09 04:12:18 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:19 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7" returned: 0 in 0.258s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:19 devstack sudo[107847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.info
Sep 09 04:12:19 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:19 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.info" returned: 0 in 0.258s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:19 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.info is being set with open permissions: ugo+rw
Sep 09 04:12:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.info {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:19 devstack sudo[107850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.info
Sep 09 04:12:19 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:19 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.info" returned: 0 in 0.250s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:19 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:12:19 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-92fd3325-5102-4e5f-9f2b-9b2e95040393 tempest-SnapshotDependencyTests-95285380 None] Create snapshot completed successfully
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.flows.manager.create_volume [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87558) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Flow 'volume_create_manager' (47db1c66-b115-4a4b-98a0-38f17bcf5294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48f9853-2527-41c8-b9d4-43d49f2be6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48f9853-2527-41c8-b9d4-43d49f2be6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T02:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07607d61-2513-4bc9-9caf-de8e8ad46a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4225416efe5d4b4b84beba52fd15f10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d14573c4-21f3-4f20-8398-ca4945cb16c7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:12:20Z,use_quota=True,user_id='8989f9c55788406f9b8408677aab2b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8118c463-d61d-4430-b7e4-ff1f7b6fd309),volume_type_id=8118c463-d61d-4430-b7e4-ff1f7b6fd309)' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7de1bd-74f6-46d6-9af9-c4a9f3914b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7de1bd-74f6-46d6-9af9-c4a9f3914b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161e8424-c796-48f0-bffc-d86e0ad8c134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161e8424-c796-48f0-bffc-d86e0ad8c134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '07607d61-2513-4bc9-9caf-de8e8ad46a1e', 'volume_name': 'volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e', 'volume_size': 1, 'snapshot_id': 'd14573c4-21f3-4f20-8398-ca4945cb16c7'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e95b85-67f3-422a-8123-0d8998c7da5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e95b85-67f3-422a-8123-0d8998c7da5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b152aa94-164e-4542-862a-059af843b07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:12:20 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Volume 07607d61-2513-4bc9-9caf-de8e8ad46a1e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e', 'volume_size': 1, 'snapshot_id': 'd14573c4-21f3-4f20-8398-ca4945cb16c7'}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "cinder-quobyte-d14573c4-21f3-4f20-8398-ca4945cb16c7-07607d61-2513-4bc9-9caf-de8e8ad46a1e" by "_create_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-quobyte-d14573c4-21f3-4f20-8398-ca4945cb16c7-07607d61-2513-4bc9-9caf-de8e8ad46a1e" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Creating volume 07607d61-2513-4bc9-9caf-de8e8ad46a1e from snapshot d14573c4-21f3-4f20-8398-ca4945cb16c7 {{(pid=87558) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Selected osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc as target Quobyte volume. {{(pid=87558) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "cinder-quobyte-07607d61-2513-4bc9-9caf-de8e8ad46a1e" by "_copy_volume_from_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-quobyte-07607d61-2513-4bc9-9caf-de8e8ad46a1e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] snapshot: d14573c4-21f3-4f20-8398-ca4945cb16c7, volume: 07607d61-2513-4bc9-9caf-de8e8ad46a1e,  {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeb85a8-ee02-472f-9028-a2fcd4fdb55a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:12:20 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:20 devstack sudo[107853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7
Sep 09 04:12:20 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:21 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7" returned: 0 in 0.355s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:12:21 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8efaad-8f97-4254-978c-d6c734b48d28]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:12:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:21 devstack sudo[107858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4
Sep 09 04:12:21 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:21 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4" returned: 0 in 0.359s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 04:12:21 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Creating direct copy from snapshot {{(pid=87558) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 04:12:21 devstack cinder-volume[87558]: DEBUG cinder.utils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Path /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e not found in is_blk_device check {{(pid=87558) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 04:12:21 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:21 devstack sudo[107863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e
Sep 09 04:12:21 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:25 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e" returned: 0 in 3.898s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:25 devstack cinder-volume[87558]: DEBUG cinder.image.image_utils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Image conversion details: src /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4, size 1024.00 MB, duration 3.90 sec, destination /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e {{(pid=87558) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 04:12:25 devstack cinder-volume[87558]: INFO cinder.image.image_utils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Converted 1024.00 MB image at 262.59 MB/s
Sep 09 04:12:25 devstack cinder-volume[87558]: WARNING cinder.volume.drivers.remotefs [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e is being set with open permissions: ugo+rw
Sep 09 04:12:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:25 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e
Sep 09 04:12:25 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:25 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e" returned: 0 in 0.234s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:25 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-quobyte-07607d61-2513-4bc9-9caf-de8e8ad46a1e" released by "_copy_volume_from_snapshot" :: held 4.921s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:12:25 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-quobyte-d14573c4-21f3-4f20-8398-ca4945cb16c7-07607d61-2513-4bc9-9caf-de8e8ad46a1e" released by "_create_volume_from_snapshot" :: held 4.980s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:12:25 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.997s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:12:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b152aa94-164e-4542-862a-059af843b07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e', 'volume_size': 1, 'snapshot_id': 'd14573c4-21f3-4f20-8398-ca4945cb16c7'}' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:12:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff98c476-cc1f-420c-90ce-7b269820d426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 04:12:25 devstack cinder-volume[87558]: INFO cinder.volume.flows.manager.create_volume [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Volume volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e (07607d61-2513-4bc9-9caf-de8e8ad46a1e): created successfully
Sep 09 04:12:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff98c476-cc1f-420c-90ce-7b269820d426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87558) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 04:12:25 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Flow 'volume_create_manager' (47db1c66-b115-4a4b-98a0-38f17bcf5294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87558) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 04:12:25 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-40750092-2d89-46e8-9473-a7a7fb15da00 tempest-SnapshotDependencyTests-95285380 None] Created volume successfully.
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "cinder-d14573c4-21f3-4f20-8398-ca4945cb16c7-delete_snapshot" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-d14573c4-21f3-4f20-8398-ca4945cb16c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "cinder-quobyte-faa43089-bb3b-4d83-8ea4-5ab8b8beded4" by "delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-quobyte-faa43089-bb3b-4d83-8ea4-5ab8b8beded4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "cinder-quobyte-d14573c4-21f3-4f20-8398-ca4945cb16c7" by "_delete_snapshot" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-quobyte-d14573c4-21f3-4f20-8398-ca4945cb16c7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Deleting offline snapshot d14573c4-21f3-4f20-8398-ca4945cb16c7 of volume faa43089-bb3b-4d83-8ea4-5ab8b8beded4 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] snapshot_file for this snap is: volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7 {{(pid=87558) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87a855d-5b26-4e13-8763-e8662d825042]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:26 devstack sudo[107886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7
Sep 09 04:12:26 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:26 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7" returned: 0 in 0.346s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.remotefs [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87558) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec3ce31-dbe8-41b5-8909-11d752a4df89]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:26 devstack sudo[107891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4
Sep 09 04:12:26 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:12:26 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:27 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4" returned: 0 in 0.503s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:27 devstack sudo[107896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:12:27 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:27 devstack sudo[107898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7
Sep 09 04:12:27 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:27 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.240s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG oslo_service.periodic_task [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87558) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread count: 29 {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG cinder.volume.manager [None req-34cfdbbd-7476-4974-ae5b-121f40c357d3 None None] thread info: [<_MainThread(MainThread, started 137725769285760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137725660043776)>, <Thread(Thread-3 (stat_writer), started daemon 137725655842048)>, <Thread(Rabbit-heartbeat, started daemon 137725658767360)>, <Thread(Thread-5 (_runner), started daemon 137725655005056)>, <Thread(Thread-7 (_runner), started daemon 137725655071296)>, <Thread(fd_logger, started daemon 137725654985408)>, <Thread(privsep_reader, started daemon 137725648559104)>, <Thread(Rabbit-heartbeat, started daemon 137725644881280)>, <Thread(tpool_thread_0, started daemon 137725642122944)>, <Thread(tpool_thread_1, started daemon 137725633730240)>, <Thread(tpool_thread_2, started daemon 137725625337536)>, <Thread(tpool_thread_3, started daemon 137725616944832)>, <Thread(tpool_thread_4, started daemon 137725608552128)>, <Thread(tpool_thread_5, started daemon 137725600159424)>, <Thread(tpool_thread_6, started daemon 137725591766720)>, <Thread(tpool_thread_7, started daemon 137725583374016)>, <Thread(tpool_thread_8, started daemon 137725574981312)>, <Thread(tpool_thread_9, started daemon 137725566588608)>, <Thread(tpool_thread_10, started daemon 137725558195904)>, <Thread(tpool_thread_11, started daemon 137725549803200)>, <Thread(tpool_thread_12, started daemon 137725541410496)>, <Thread(tpool_thread_13, started daemon 137725533017792)>, <Thread(tpool_thread_14, started daemon 137725524625088)>, <Thread(tpool_thread_15, started daemon 137725516232384)>, <Thread(tpool_thread_16, started daemon 137725507839680)>, <Thread(tpool_thread_17, started daemon 137725499446976)>, <Thread(tpool_thread_18, started daemon 137725491054272)>, <Thread(tpool_thread_19, started daemon 137725482661568)>] {{(pid=87558) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 04:12:27 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7" returned: 0 in 0.323s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:27 devstack sudo[107904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7
Sep 09 04:12:27 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:27 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4.d14573c4-21f3-4f20-8398-ca4945cb16c7" returned: 0 in 0.243s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-quobyte-d14573c4-21f3-4f20-8398-ca4945cb16c7" released by "_delete_snapshot" :: held 1.503s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-quobyte-faa43089-bb3b-4d83-8ea4-5ab8b8beded4" released by "delete_snapshot" :: held 1.528s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Created reservations ['696639af-ce8b-44f2-8e16-76d9619b3b28', 'a63f7490-2367-46db-89b3-f3d7b4d19257', 'cf15d7a5-7477-42a1-99c5-3cd8846e3e0f', '757c3f81-c3cb-4a69-9214-233de3958d4f'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:12:27 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Delete snapshot completed successfully.
Sep 09 04:12:27 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-405091b9-10a0-41ed-a989-be130ca65f40 tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-d14573c4-21f3-4f20-8398-ca4945cb16c7-delete_snapshot" released by "delete_snapshot" :: held 1.650s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:12:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "cinder-faa43089-bb3b-4d83-8ea4-5ab8b8beded4-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:12:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-faa43089-bb3b-4d83-8ea4-5ab8b8beded4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:12:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "cinder-quobyte-faa43089-bb3b-4d83-8ea4-5ab8b8beded4" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:12:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-quobyte-faa43089-bb3b-4d83-8ea4-5ab8b8beded4" acquired by "delete_volume" :: waited 0.014s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:12:28 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[c629a8d9-fc41-4af1-aaf8-068c3785b16c]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:12:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:28 devstack sudo[107907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4
Sep 09 04:12:28 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:28 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4" returned: 0 in 0.342s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:28 devstack sudo[107912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4
Sep 09 04:12:28 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:28 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:28 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-faa43089-bb3b-4d83-8ea4-5ab8b8beded4" returned: 0 in 0.247s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:28 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-quobyte-faa43089-bb3b-4d83-8ea4-5ab8b8beded4" released by "delete_volume" :: held 0.641s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:12:28 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Created reservations ['8d3275ce-69a6-4d8e-8692-5475a0d59708', '9d076d42-228e-4dff-9999-b1eb5150b2c7', '2002af21-c529-4d6c-8839-09bc2bf0dbed', '893faaf0-dacc-4e97-bf39-03b0b73808b9'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:29 devstack sudo[107915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:12:29 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:29 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.238s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:12:29 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Deleted volume successfully.
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-e6f467f1-65fe-4200-81d7-bdecffd6c70b tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-faa43089-bb3b-4d83-8ea4-5ab8b8beded4-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "cinder-07607d61-2513-4bc9-9caf-de8e8ad46a1e-delete_volume" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-07607d61-2513-4bc9-9caf-de8e8ad46a1e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "cinder-quobyte-07607d61-2513-4bc9-9caf-de8e8ad46a1e" by "delete_volume" {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-quobyte-07607d61-2513-4bc9-9caf-de8e8ad46a1e" acquired by "delete_volume" :: waited 0.013s {{(pid=87558) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8aabab-263f-415d-b519-991e9978c70a]: (4, 'qcow2') {{(pid=89225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:29 devstack sudo[107918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e
Sep 09 04:12:29 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:29 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e" returned: 0 in 0.354s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:29 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:29 devstack sudo[107923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e
Sep 09 04:12:29 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:30 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7/volume-07607d61-2513-4bc9-9caf-de8e8ad46a1e" returned: 0 in 0.241s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-quobyte-07607d61-2513-4bc9-9caf-de8e8ad46a1e" released by "delete_volume" :: held 0.634s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:12:30 devstack cinder-volume[87558]: DEBUG cinder.quota [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Created reservations ['ef05f3ed-60ce-4a27-ac68-f213014428b8', '88056c54-fa80-4726-8e48-36927eca147b', '866d79d5-9fba-4366-929a-2c1f0fd262e9', '18b6006c-8caf-4704-9c61-49a9d5b8198e'] {{(pid=87558) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 04:12:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 04:12:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 04:12:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc': None} {{(pid=87558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 04:12:30 devstack cinder-volume[87558]: DEBUG cinder.volume.drivers.quobyte [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a974241-d386-458c-ae0a-abf833eb7adc'] {{(pid=87558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 04:12:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.lockutils [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 04:12:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7 {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 04:12:30 devstack sudo[107926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7
Sep 09 04:12:30 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 04:12:30 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root
Sep 09 04:12:30 devstack cinder-volume[87558]: DEBUG oslo_concurrency.processutils [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d580f43a0b10ad1ebd071bced923c8c7" returned: 0 in 0.236s {{(pid=87558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 04:12:30 devstack cinder-volume[87558]: DEBUG cinder.manager [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Notifying Schedulers of capabilities ... {{(pid=87558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 04:12:30 devstack cinder-volume[87558]: INFO cinder.volume.manager [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Deleted volume successfully.
Sep 09 04:12:30 devstack cinder-volume[87558]: DEBUG cinder.coordination [None req-dd37e3f6-bdf2-4f3e-97da-1a1679b0697a tempest-SnapshotDependencyTests-95285380 None] Lock "cinder-07607d61-2513-4bc9-9caf-de8e8ad46a1e-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87558) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 04:12:40 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 04:12:40 devstack cinder-volume[87558]: DEBUG dbcounter [-] [87558] Writing DB stats cinder:UPDATE=30,cinder:SELECT=26,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}